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Preface 

We present a coherent collection of finite mathematical theorems some of 
which can only be proved by going well beyond the usual axioms for mathe- 
matics. The proofs of these theorems illustrate in clear terms how one uses the 
well studied higher infinities of abstract set theory called large cardinals in an 
essential way in order to derive results in the context of the natural numbers. 
The findings raise the specific issue of what consitutes a valid mathematical 
proof and the general issue of objectivity in mathematics in a down to earth 
way. 

Large cardinal axioms, which go beyond the usual axioms for mathematics, 
have been commonly used in abstract set theory since the 1960's (e.g., see 
[Sc61], [MS89]). We believe that the results reported on here are the early 
stages of an evolutionary process in which new axioms for mathematics will be 
commonly used in an essential way in the more concrete parts of mathematics. 

We wish to thank John Burgess, Tim Carlson, Randy Dougherty, Charles 
Fefferman, Ronald Graham, Leo Harrington, Carl Jockusch, Si Kochen, Rich 
Laver, Tony Martin, Barry Mazur, Gian-Carlo Rota, Paul Sally, Joe Shipman, 
Steve Simpson, Ted Slaman, Joel Spencer, Robert Stanton, and John Steel for 
valuable conversations and encouragement. 

Abstract 

We begin by presenting a new kind of finite counting theorem which asserts 
that any function on vectors of natural numbers has few low values over finite 
sets of arbitrary size (Theorems 0.1 and 0.2 from the introduction). 

This estimate on the low values (herein called regressive values) is linear 
in the sizes of the finite sets. 

This basic counting theorem is extended to systems of finite functions, 
where it is shown that every system which is "decreasing" (in appropriate 
senses) includes functions which have even fewer low values over finite sets 
of arbitrary size. This improved estimate is a constant depending on the di- 
mension and not on the sizes of the finite sets (see Proposition A from the 
introduction) . 

However, these extended results can only be proved by using additional 
axioms which go well beyond the currently accepted axioms for mathematics 
(as usually formalized by ZFC = Zermelo Frankel set theory with the axiom 
of choice). Furthermore, the extended results have obviously equivalent finite 
forms, which remove any mention of infinite sets (see Proposition B from the 
introduction). See Theorem 5.91 and Corollary 1. 

The additional axioms used in the proof of these extended results are 
among the so called large cardinal axioms that have been extensively used in 
set theory since the 1960's (see e.g., [Sc61], [MS89]). The proofs here illustrate 
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in clear terms how one uses large cardinals in an essential and completely 
natural way in the integers. A conceptual overview of the method is described 
at the end of the introduction. 

The quest for a simple meaningful finite mathematical theorem that can 
only be proved by going beyond the usual axioms for mathematics has been a 
goal in the foundations of mathematics since Godel's work in the 1930's [Go31]. 

Prior relevant developments include the introduction of the forcing method 
in [C066] , which was used to establish the unprovability of the continuum hy- 
pothesis from the usual axioms of mathematics (the consistency having been 
previously established in [Go40]). But for theoretical reasons, the forcing 
method cannot establish the independence of a finite statement, at least not 
directly (see [Fr92, p. 54] and "absoluteness" in [Je78, p. 101-108]). 

Another relevant development was the first example of a simple meaning- 
ful finite mathematical theorem (in Ramsey theory) whose proof requires some 
weak use of infinite sets, in [PH77]. This was followed by a simple meaningful 
finite mathematical theorem in graph theory (related to J. B. Kruskal's the- 
orem) whose proof requires some weak use of uncountable sets, [Si85], and a 
further, simply stated theorem in graph theory (related to the graph minor 
theorem), [FRS87], whose proof requires stronger uses of uncountable sets. 

Other relevant developments include the first example of a simple mean- 
ingful mathematical theorem involving Borel measurable functions whose proof 
requires use of uncountably many infinities, [Fr71], and the first example of a 
simple meaningful mathematical theorem involving Borel measurable functions 
show that proof requires axioms going far beyond the usual axioms for math- 
ematics, [Fr81], [St85]. 

As is clear from the body of this abstract, the results - which are prov- 
able only by going well beyond the usual axioms for mathematics - are well 
connected with existing topics in finite and discrete combinatorics (Ramsey 
theory), and form a coherent body of examples. We anticipate that a variety 
of simple and basic examples will be found with increasingly strong connections 
to diverse areas of mathematics. 

Introduction 

We let iV be the set of all nonnegative integers. For x € N k , we let min(x) 
be the minimum coordinate of x, and \x\ be the maximum coordinate of x (sup 
norm). We also use | | for the cardinality of finite sets. 

For n £ N, we write [n] for {0, 1, . . . ,n — 1}. For k > and X a set, 
we write S(X) for the set of all subsets of X, and Sk(X) for the set of all k 
element subsets of X. 

We begin with a statement of the usual classical infinite Ramsey theorem 
(IRT). 
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Infinite Ramsey Theorem. Let k,r > and F:Sk(N) — > [r]. Then 
there exists an infinite E C TV suc/i i/iai F is constant on Sk(E). 

We also state the usual finite Ramsey theorem (FRT). See [Ra30] and 
[GRS80] for IRT and FRT (infinite and finite Ramsey theorem). 

Finite Ramsey Theorem. Letn > k,r,p > and F: Sk[n] — > [r]. Then 
there exists E € S p [n] such that F is constant on Sk(E). 

Here, as elsewhere, we use ^> for "sufficiently greater than." In this use, 
the full expansion of the first sentence would read: 

For all k, r,p > there exists m such that for all 

n> m and F: Sk[n] — > [r], the following holds. 

Of course, in this well as in all subsequent cases, this can be simplified 

to read: 

For all k,r,p > there exists n such that for all 

F: Sk[n] — > [r], the following holds. 

The first simple meaningful finite mathematical theorem that is indepen- 
dent of Peano Arithmetic is given in [PH77], Theorem 1.2: 

Paris-Harrington- Ramsey Theorem. Let n > k,r,p > and 
i^Sfcfn] — > [r]. T/ien t/iere exists E 1 C [n], jE 1 ) > p, min(E), smc/i i/iai F is 
constant on Sk(E). 

We now present two counting theorems of a different flavor from the PH 
Ramsey Theorem, but which share its metamathematical properties. We first 
give their infinite forms (Theorems 0.1 and 0.2), and then follow it by their 
obvious finite forms (Theorems 0.3 and 0.4). Theorem 0.2 leads to the simple 
meaningful mathematical theorems of Part 4 (Propositions A-D) which can 
only be proved by going well beyond the usual axioms for mathematics. 

Theorem 0.1. Let k,r,p > and F:N k — > N r obey the inequality 

\F(x)\ < min(x) . 

Then there exists E € S P (N) such that 

\F[E k }\ < {k k )p. 

We now turn this around so that it asserts a combinatorial property of 
any function F: N k — > N T '. 

Let A,BQ N k , and F: A — > N r . We say that y is a regressive value of F 
on B if and only if there exists x € B such that F(x) = y and \y\ < min(x). 
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Example. Let F: N 2 —> N be given by F(x,y) = (x — y) 2 . Then every 
square is a regressive value of F on N 2 . But the only regressive value of F on 
{1,2,4,... } 2 is 0. 

Theorem 0.2. Let k,r,p > and F:N k -» N r . Then F has < (k k )p 
regressive values on some E k C N k , \E\ = p. 

We now state the obvious finite forms of Theorems 0.1 and 0.2: 

Theorem 0.3. Let n » k,r,p > and F: [n] k — > [n] r obey the inequality 

\F(x)\ < min(z) . 

Then there exists E G S p [n] such that 

\F[E k ]\<(k k )p. 

Theorem 0.4. Let n > k,r,p > and F:[n] k — > [n] r . T/ien F /ias 
< (/c fc )p regressive values on some E k C [n] fc , = p. 

We could have used < instead of < in the definition of regressive value. 
The reason we used < is because of the following set theoretic result, which is 
a hint of things to come. 

Theorem 0.5. Let k, r,p > and F: X k — > A r , where X is a suitably large 
cardinal. Then F has < k k regressive values on some E k C \ k , \E\ = p. 

A function assignment for a set X is a mapping U which assigns to each 
finite subset A of X, a unique function 

U(A):A -> A. 

The following is easily obtained from Theorem 0.4. 

Theorem 0.6. Let k,p > and U be a function assignment for N k . 
Then some U(A) has < (k k )p regressive values on some E k C A, \E\ = p. 

We want to place a natural condition on function assignments for N k so 
that we get the improved estimate appearing in Theorem 0.5. 

The main condition that we use is ^-decreasing, which is stated informally 
as follows: 

When a vector is inserted, the function extends or drops higher up. 

More formally, let U be a function assignment for N k . 
We say that U is ^-decreasing if and only if for all finite A C iV fc and 
x <E N k , 
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either U(A) C U(A U {x}) or there exists 
\y\ > \x\ such that \U(A)(y)\ > \U(A U {x})(y)\. 
^-decreasing is stronger than it appears, and is quite stable. It implies a 
rather complete picture of the relationship between U(A) and U(Au{x}). For 
instance, U is ^-decreasing if and only if for all finite A C N k and x £ N k , 
either U(A) C.U(AU {x}), or there exists \y\ > \x\ such that 

(i) \U(A)(y)\>\U(AU{x})(y)\; 

(ii) for all zei,if \z\ < \y\, then U{A)(z) = U(A U {s})(z); 

(hi) for all z € A, if |z| = |y|, then 17(A) (z) = f/(iU{i})(z) or \U(A)(z)\ > 
\U(Au{x})(z)\. 

We also consider lex ^-decreasing function assignments U for N k . Lex 
decreasing is defined in exactly the same way as ^-decreasing, except > is 
replaced by >i ex , where >i ex is according to the usual lexicographical ordering 
of N k . 

The main result is that the following proposition is independent of ZFC, 
and can be proved used certain large cardinal axioms, but not without them: 

Proposition A. Let k,p > and U be a ^-decreasing {lex ^-decreasing) 
function assignment for N k . Then some U(A) has < k k regressive values on 
some E k C A, \E\ = p. 

At the end of this introduction, we indicate the general strategy for proving 
Proposition A from large cardinals. 

We now state the obvious finite form of Proposition A. Clearly ^-decreas- 
ing and lex ^-decreasing make perfectly good sense for function assignments 
for [n] k . 

PROPOSITION B. Let n > k,p > and U be a ^-decreasing (lex #- 
decreasing) function assignment for [n] k . Then some U{A) has < k k regressive 
values on some E k C A, \E\ =p. 

Proposition B immediately implies Proposition A. Also Proposition B can 
be derived from Proposition A using a standard compactness (finitely branch- 
ing tree) argument. 

Note that ^-decreasing is based on the ordering of N k by the sup norm 
and lex ^-decreasing is based on the lexicographic ordering. We now give an 
abstract form of Proposition A which uses other orderings. 

A strict order on N k is a transitive irreflexive binary relation < on N k . 

We write < c for the order on N k defined by: x < c y if and only if for all 
1 < i < k, Xi < yi. 

We say that < is an upward order on N k if and only if < is a strict order 
on N k such that x < c y implies ->(y < x). Observe that \x\ < \y\ and the strict 
lexicographic orderings on N k are upward orderings on N k . 
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Let <i, <2 be orders on N k and U be a function assignment for N k . 
We say that U is <i, <2-#-decreasing if and only if for all finite A C N k 
and x G N k , 

either U(A) CU(A(J {x}) or there exists 
y >i x such that f7(A)(y) > 2 U(A U {x})(y). 

PROPOSITION C. Let k,p > 0, <i, <2 6e upward orders on N k , and U 
be a <i, <2-#- decreasing function assignment for N k . Then some U(A) has 
< k k regressive values on some E k C A, \E\ = p. 

We also have the following equivalent finite form: 

Proposition D. Let n 3> k,p > 0, <i, <2 &e upward orders on [n] k , and 
U be a < i, <2-#- decreasing function assignment for [n] k . Then some U(A) 
has < /c fc regressive values on some E k C A, = p. 

We conjecture that Propositions A-D are equivalent to a single meta- 
mathematical statement which asserts the 1-consistency of ZFC + {there ex- 
ists a /c-subtle cardinal} fc. See the discussion of large cardinals in Part 2. In 
this manuscript, we will prove that all forms of Propositions A-D imply the 
consistency of ZFC + {there exists a /c-subtle cardinally, and that they are all 
provable from ZFC+ "for all k there exists a /c-subtle cardinal." 

In Part 2 we give ten presentations of the hierarchy of cardinals used in 
the previous paragraph, as well as nine formulations of the existence of the 
hierarchy taken as a whole (Th. 2.11). In the previous paragraph, any of these 
can be used instead of talking about /c-subtle cardinals. From the set theoretic 
point of view, a very appealing choice is k — SRP (the stationary Ramsey 
property of order k), which is stated as follows: 

Let Sk(X) be the set of all k element subsets of the set X. We say that 
an infinite cardinal A is k — SRP if and only if for all F: Sfc(A) — ► {0, 1} there 
exists stationary E C A such that F is constant on Sk(E). 

The /c-critical linear orderings are natural from the point of view of gen- 
eral mathematics. Let (X, <) be a linear ordering with no endpoints. We 
say that F:X k — > X is regressive if and only if for all x±, . . . ,Xk, we have 
F(x±, . . . , Xk) < min(xi, . . . , x^). Now (X, <) is /c-critical if and only if for all 
regressive F: X k — > X there exist b\ < ■ ■ ■ < bk+i such that F(bi, . . . ,bk) = 
F(b 2 , ■ ■ -,b k+1 ). 

The general strategy for using large cardinals in the integers is as follows. 

We start with a discrete (or finite) structure X obeying certain hypotheses 
H. We wish to prove that a certain kind of finite configuration occurs in X, 
assuming that H holds. We define a suitable concept of completion in the 
context of arbitrary linearly ordered sets. We verify that if X has a completion 
with the desired kind of finite configuration, then X already has the desired 
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kind of finite configuration. We then show, using hypotheses H, that X has 
completions of every well-ordered type. We now use the existence of a suitably 
large cardinal A. Using large cardinal combinatorics, we show that in any 
completion of order type A, the desired kind of finite configuration exists. 
Hence the desired kind of finite configuration already exists in X. 

In the case of Proposition A, we can spell out the strategy in more specific 
terms as follows. 

(1) Show that ^-decreasing implies some additional conditions, the most 
important of which is end-preserving (Theorem 3.10). 

(2) Using the classical infinite Ramsey theorem, show that every ^-decreasing 
function assignment can be made "uniform" so that every function is order 
isomorphic to an original function (Theorem 4.2). 

(3) Define completion of function assignments. These are linearly ordered 
functions (functions from a Cartesian power of a linearly ordered set into itself) 
such that every finite set has a finite superset on which the function is order 
isomorphic to an element of the function assignment (immediately following 
the proof of Theorem 4.8). 

(4) Show that every uniform function assignment has (unique) completions 
of every well-ordered type (Theorem 4.9). The crucial argument by transfi- 
nite recursion is entirely natural (Theorem 4.8). This is called the ordinal 
completion property. 

(5) Finally we use the large cardinal. Show that every function on the large 
cardinal has few regressive values on Cartesian powers of every finite size 
(Lemma 4.10). This is a straightforward argument in large cardinal combi- 
natorics. 

(6) Conclude that some element of the function assignment has the desired 
property by quoting the definition of completion (Theorem 4.11). 



1. Counting values 

In this part we show that Theorems 0.3 and 0.4 from the introduction 
are independent of Peano Arithmetic (PA) and have other metamathematical 
properties. Theorems 0.2 and 0.4 are extended in Part 4 to finite combinatorial 
results that can only be proved by using large cardinals. 

We say that x, y € N k are of the same order type if and only if for all 
1 < i,j 1 < k, Xi < Xj if and only if yi < yj. Other notation was explained in 
the introduction. 

Let ot(fc) be the number of order types of elements of N k . It is obvious 
that ot(k) < k k (every element on N k has the same order type as an element 
of [k] k ), and a straightforward inductive argument shows that ot(fc) < 2 k (kl). 
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It is easy to see that ot(fc) = ^ f(k,i), where f(k,i) is the number of 

l<i<fc 

surjective maps from [k] onto [i]. In [Gr62] it is shown that ot(fc) is asymptotic 
to /t!/21n fc+1 2. 

Let F:Sk(N) — > TV. We say that F is regressive if and only if for all 
x € Sk(N), if min(x) > then F(x) < min(x). 
[KM87] analyzes the following result. 

Theorem I. Let n 3> k,p > and F:Sk[n] — ► [n] be regressive. Then 
there exists E £ S p [n] such that the following holds. For all x,y G Sk(E), if 
min(x) = min(y), then F(x) = F(y). 

Theorem I is a variant of Proposition 2.10 in [PH77], which was shown 
to be unprovable in PA. In [PH77], the Paris-Harrington statement (Theorem 
1.2) was shown to imply Proposition 2.10, thereby obtaining the unprovability 
of Theorem 1.2 from PA = Peano Arithmetic. 

The following theorem is a weak form of Theorem 0.4, which in turn 
follows from Theorem 0.3. 

Theorem II. For all k > there exists c > such that the following 
holds. Let n 3> k,p > and F: [n] k — > [n] 2 . Then there exists E G S p [n] such 
that F has < cp regressive values on E k . 

The next theorem is a strong form of Theorems I and 0.3. 

Theorem III. Let n » k,r,p > and F: [n] k — > iV r obey the inequality 

\F(x)\ < min(x) . 

Then there exists E € S p [n] such that the following holds. For all x,y € E k 
with the same order type, i/min(x) = min(y), then F(x) = F(y). 

We write 1-Con (T) for the 1-consistency of the formal system T, which 
asserts that every sentence provable in T is true. 

Define the function Hj(k,p) = the least n such that Theorem I holds for 
n, k, p. Write Hi^(p) = H\{k,p). 

Lemma 1.1 ([KM87]). Theorem I is not provable in PA. For each fixed k, 
Theorem I is provable in PA. It is provable in PA that Theorem I is equivalent 
to the 1-consistency of PA. Every < e^-recursive function is eventually < some 
Hi h. Every H\ k is a < e^-recursive function. 

We wish to obtain analogous information for Theorems II, III, 0.3, and 

0.4. 

For E C iV let Ei be the i th element of E; E\ is the least element of E. 
For n,r € N, write n*r for (n, . . . , n), where there are r n's. 
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Lemma 1.2. The following is provable in PA. Theorem III implies The- 
orem I and Theorem 0.3. Theorem 0.3 implies Theorem 0.4 implies Theorem 
II. In /act, Theorem 0.3 /or r = 2 implies Theorem 0.4 /or r = 2 implies 
Theorem II. 

Proof. It is obvious that Theorem III implies Theorem 0.3. To see that 
Theorem III implies Theorem I, let > 0. Let n be as given by Theorem 
III for fc, 1, p + 1. Let -F: Sfc[n] — > iV be regressive. Define i 7 ': — > N by 
= F(rng(x)) if x is strictly increasing and min(x) > 0; otherwise. Let 
E be as given by Theorem III. Then E\{E±} is as required by Theorem I. 

Note that the last implication in claims 2 and 3 are immediate, taking 
c = k k . So it remains to see that for fixed r, Theorem 0.3 implies Theorem 0.4. 
Accordingly, assume Theorem 0.3 for r, and let k,r,p > 0. Let n work for k, r, 
p in Theorem 0.3. Let F: [n] k -> [n] r . Define F': [n) k -> [n] r by F'(x) = F(x) 
if < min(x); 0*r otherwise. Then Theorem 0.3 applies to F' and so let 

E £ S p [n], where \F'[E k ]\ < (k k )p. Note that every regressive value of F on 
E k is a value of F' on F. Hence the number of regressive values of F on E k is 
< {k k )p as required. □ 

We now wish to prove that Theorem I implies Theorem III. For this pur- 
pose, we introduce another statement. 

Theorem IV. Let n S> k,p > and F:Sk[n] — > [n] &e regressive. Then 
there exists E G £? p [n] suc/i i/iai i/ie following holds. 

(i) For a// x,y £ Sk(E), if min(x) = min(y) t/ien F(x) = F(y); 

(ii) For all x < y from E, 2 X < y. 

Lemma 1.3. The following is provable in PA. Theorem I implies Theo- 
rem IV. 

Proof. Let /c,p > 0. Without loss of generality assume k,p > 1. Apply 
Theorem I for k, 8p + 1 + k to obtain n such that the conclusion of Theorem 
I holds. To prove that n works for k,p in Theorem IV, let F: Sk[n] — > [n] be 
regressive. 

We define a regressive G:Sk[n] — >• [n] by cases, where the operative case 
is the first one that applies. Let A € Sk[n]. 

Case I. A 2 - A x < A 1 . Define G( A) = A 2 - A x . 

Case 2. There exists j < A\ such that 2 J > A 2 . Define G(A) = greatest 
such j. 

Case 3. Otherwise. Define G(A) = F(A). 

Let E be as given by Theorem I for n, k, 8p + 3 + k. Let 1 < i < 8p + 1. 
Then by comparing G{E U E i+1 , E i+k _i) and G(E, h E i+2 , E i+k ), we see 
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that Ei + 2 — Ei > Ei, and so Ei+2 > 2Ei. Similarly, we have Ei+4 > 2Ei + 2- 
By comparing G(Ei, E i+2 , . . . , E i+k ) and G(Ei, E i+4 , E i+k+2 ), we see that 
2 Ei ~ 1 < Ei + 4. From this it follows that {Eg, En, . . . , Eg p+ \} is as required by 
Theorem IV. □ 

Lemma 1.4. T/ie following is provable in PA. Theorem IV implies The- 
orem III. 

Proof. Let fc, r,p > 0. Without loss of generality we may assume fc, r, 
p > 1. Apply Theorem IV for A; and some appropriate exponential expression 
a(k,r,p), to obtain n such that the conclusion of Theorem IV holds. Let 
F: [n] k —>■ [n] r obey the inequality in Theorem III. We define G: Sk[n] — > [n] by 
cases. Let A G Sk[n]. 

Case 1. For all 1 < i < k, > l^- 1 and A\ > a(k,r,p). For each 
tuple mi, . . . mfc from {1, . . . , k} consider F(\og(A mi ), . . . , \og(A mk )), where 
we round down to the nearest integer. This correspondence can be coded as 
an integer < A\. G(A) is the code. 

Case 2. Otherwise. Set G(A) = 0. 

Let E be as given by Theorem IV. Then the largest k elements of {log(v): 
v € E} is as required by Theorem III. □ 

Lemma 1.5. The following is provable in PA. Theorem II implies Theo- 
rem I. 

Proof. Fix k,p > 0. We apply Theorem II with dimension k to obain c 
such that the last two lines of Theorem II hold. We fix p' 3> k,p,c (according 
to the requirements of the application of FRT below). Let n be according to 
Theorem II, with k, p'. Thus the following holds: 

For all F: [n] k — > N 2 there exists E <G S p '[n] such that 

F has < cp' regressive values on E k . 

We verify that Theorem I holds for n, k, p. 

Let F: Sk[n] —* [n] be regressive. We apply Theorem II to the function 
G: [n] k — > [n] 2 given by G(x) = (F(rng(x)), | min(x) — 1|) if x is strictly increas- 
ing; (0, 0) otherwise. (Here | | is ordinary one-dimensional, absolute value.) 

According to the displayed statement, let A C [n], \A\ = p', be such 
that G has at most cp' regressive values on A k . For all b G A, let X(b) = 
{x 6 A k< :x\ = b}. (Here A k< is the set of all strictly increasing elements of 
A k .) Since the same regressive value of F cannot be obtained from arguments 
with different minimums, the pigeonhole principle tells us that 



\{b G A:G has > 2c regressive values on V(6)}| < p'/2 . 
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Hence \{b £ A:G has < 2c regressive values on A(6)}| > p'/2. That is, 
\S\ > p'/2, where S = {b £ A: F has < 2c regressive values on elements of 
Sk(A) whose min is b}. 

Now apply the Finite Ramsey Theorem in a well known way to obtain 
CCS, \C\ = p + 3ck = q, such that the following holds: 

(i) Let A, B, A', B' £ S k [C], where (A, B) is order isomorphic to (A',B'). 
Then F(A) < F(B) if and only if F(A') < F(B'); 

(ii) For all b £ C, F has < 2c regressive values on elements of S k (C) whose 
min is b. (This follows from C C S.) 

Now consider F({C\, . . . , C k }) and F({C±, C k +i, ■ ■ ■ , C2k-i})- If these are 
distinct, then by shifting the elements above Ci, and keeping C\ fixed, and 
by (i), we get a strictly monotone sequence of values. The number of these 
values is > 2c, and hence we contradict (ii). Therefore, F({C\, . . . ,Ck}) = 
F({Ci,Ck+i, ■ ■ ■ , C 2 k-i}) = F({Ci,C q - k+2 , • • • , C q }). 

Let C = {C U ...,C P }. Then by (i), for all A G S k (C), F{A) = 
F({Ai,C q -k+2, ■ ■ ■ , C q }). Therefore, C is as required by Theorem I. □ 

Theorem 1.6. The following are provably equivalent in PA: 

(i) Theorem I; 

(ii) Theorem II; 
(hi) Theorem III; 

(iv) Theorem 0.3; 

(v) Theorem 0.4; 

(vi) l-Con(PA). 

Proof, (i) <-> (vi) by Lemma 1.1. (hi) — > (i) by Lemma 1.2. (hi) — > (iv) 
— > (v) — > (ii) by Lemma 1.2. (ii) — > (i) by Lemma 1.5. (i) — > (hi) by Lemmas 
1.3 and 1.4. 

Hence (i) — > (hi) — > (iv) — > (v) — > (ii) — > (i). Therefore (i)-(v) are equiv- 
alent. Hence (i)-(vi) are equivalent. □ 

We now want to consider associated numerical functions. Recall the def- 
inition of Hi(k,p) as the least n such that Theorem I holds for n,k,p. Let 
Hni(k,r,p) be the least n such that Theorem III holds for n,r,k,p. Let 
Ho.3(k,r,p) be the least n such that Theorem 0.3 holds for n,k,r,p. Let 
Ho.4(k,r,p) be the least n such that Theorem 0.4 holds for n, k,r,p. Let 
#iii,ifc) #o.3,fc> ^0.4,fc be the respective cross sections. We use ii 7 instead of if 
if we fix r = 2. 

Lemma 1.7. For each fixed k, Theorems I, III, 0.3, and 0.4 are provable 
in PA. There is a primitive recursive function h such that the following hold. 
Let k, r,p > 1. 
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(i) H m {k,r,p) > H . 3 (k,r,p) > H 0A (k,r,p); 

(ii) if n > h(k,p), then Ho A (k,2,n) > H\{k,p). 

Proof. This results from the proofs of the previous lemmas. The function 
h is associated with FRT. □ 

theorem 1.8. The Hi k, Hin,k, Ho.3,k, o-nd i?o.4,fc are all < e^-recursive 
functions. Each of the four hierarchies of functions i?Lfc, H' lllk , H' Q;ik , and 
i^Q 4fc are cofinal in the < £q -recursive functions in the sense that every < Eq- 
recursive function is eventually < some function in the hierarchy. 

Proof. The four functions are provably recursive functions of PA, and 
hence are < £o- recur sive functions. 

For the second claim, from Lemma 1.7 we see that there exists a prim- 
itive recursive function h such that for all k > 1 and n > h(k,p), we have 

#m,fc( n )> H 'o.3,k( n )' H 0A,k( n ^ - H ~L,k(P)- B y Lemma 1.1, the H^ k are cofinal 
in the < eo-recursive functions. 

Without loss of generality we may assume that for each k > 1, h(k,p) is 
a strictly increasing function of p > 1 . 

Now let J: iV — > N be a < eo-recursive function. Without loss of gen- 
erality, assume that J is strictly increasing. Let W: N — > iV be a strictly 
increasing primitive recursive function such that for all k, and all sufficiently 
large p relative to k, W{p) > h(k,p + 1). 

Since J{W{p)) is also a < eo-recursive function, we can fix k,t > 1 such 
that for allp > t, H^ k {p) > J{W{p)) > J(h(k,p+1)). Now let n > h{k,t). Fix 
p >t such that h(k,p+ 1) > n > h(k,p). Then H' m k , H' 3 k (n) , H' 4 k (n) > 
Hi, k (p) > J(W(p)) > J(h(k,p+ 1)) > J(n), as required. □ 

2. Large cardinals 

The concepts of subtle, almost ineffable, and ineffable cardinals were in- 
troduced in an unpublished manuscript of R. Jensen and K. Kunen from 1971, 
and a number of basic facts were proved there. These concepts were extended 
to that of A:-subtle, A;-alsmost ineffable, and /c-ineffable cardinals by [Ba75], 
and a number of results were proved. 

These are the large cardinals that we use to prove Propositions A-D in 
Part 4, and that we show are required to prove Propositions A-D in Part 5. 
In this part, we give a self-contained presentation of the basic facts about 
these concepts. We also give some new characterizations of these cardinals in 
much less set theoretic terms. Some of these are based on linearly ordered sets 
instead of ordinals. The proofs of our results will appear in [Froo]. 

As is usual in set theory, we treat cardinals and ordinals as von Neumann 
ordinals. We use u> for the first limit ordinal, which is also N. For sets X and 
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k € u, we let Sk(X) be the set of all k element subsets of X. Let S(X) be the 
set of all subsets of X. Let \X\ be the cardinal of X. 

Let A be an infinite cardinal. We say that A is regular if and only if every 
function from an element of A into A is bounded in A. We say that A is strongly 
inaccessible if and only if A is uncountable, regular, and for all cardinals k < A, 
\S{k)\<\. 

We say that C C A is closed unbounded if and only if the sup of C is A, 
and for all limit ordinals x < A, if the sup of the elements of C below x is x, 
then x G C. 

We say that A C A is stationary if and only if it intersects every closed 
unbounded subset of A. 

For any k element set A and 1 < i < k, we define Ai to be the i th least 
element of A. In particular, min( J 4) = A\. 

We say that /:5&(A) — > A is regressive if and only if for all A G Sfc(A), 
either f(A) < mm(A) or min(A) = 0. 

We say that /: 5&(A) — > 5(A) is regressive if and only if for all A <G 5fc(A), 
/(-A) C min(A). We say that is /-homogeneous if and only if E C A and for 
all C,D e Sk(E), we have 

/(C) n min(C U .D) = /(D) n min(C U D) . 
Note. There is a slight abuse of notation here in that every map into A 
can be viewed as a map into S(\). This will not cause any difficulties. 

We now give the three leading definitions from [Ba75]: 
Let k be an integer > 0. A is fc-subtle if and only if 

(i) A is an infinite cardinal; 

(ii) For all closed unbounded CCA and regressive /:5fc(A) — > 5(A), there 
exists an /-homogeneous A £ 5fc + i(C). 

A is fc-almost ineffable if and only if 

(i) A is an infnite cardinal; 

(ii) For all regressive /: 5&(A) — > 5(A), there exists an /-homogeneous A C A 
of cardinality A. 

A is fc-ineffable if and only if 

(i) A is an infinite cardinal; 

(ii) For all regressive /:5fc(A) — > 5(A), there exists an /-homogeneous sta- 
tionary A C A. 

[Ba75] does not define A is 0-subtle, 0-almost ineffable, or 0-ineffable. The 
appropriate definition is that A is an uncountable regular cardinal. 
We begin with the hierarchy theorem. 

Theorem 2.1 ([Ba75]). Let k > and A be an infinite cardinal. If 
A is k + l-subtle (k + 1-almost ineffable, k + 1-ineffable), then A is k-subtle 
(k-almost ineffable, k -ineffable) . If X is k + l-subtle (k + 1-almost ineffable, 
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k+l-ineffable) , then there are X many k-subtle (k-almost ineffable, k-ineffable) 
cardinals below X. 

We also have the following relationships between the three concepts. 

Theorem 2.2 ([Ba75]). Let k > and X be an infinite cardinal. If A 
is k-ineffable, then A is k-almost ineffable. If X is k-almost ineffable, then X 
is k-subtle. Let k > 1. If X is k-ineffable, then there are X many k-almost 
ineffable cardinals below X. If X is k-almost ineffable, then there are X many 
k-subtle cardinals below X. If X is k+1 -subtle, then there are X many k-ineffable 
cardinals below X. 

So the weakest of these large cardinal properties is 1-subtle, which is 
normally just called subtle. From Theorems 2.1 and 2.2, we see that any k- 
subtle, fc-almost ineffable, or /c-ineffable cardinal, k > 1, is subtle. How big is 
a subtle cardinal? 

Theorem 2.3 ([Ba75]). Every subtle cardinal is strongly inaccessible. 

Strongly inaccessible cardinals are just beyond the scope of ZFC (they 
cannot be proved to exist within ZFC). Thus subtle cardinals are also beyond 
the scope of ZFC. 

Actually, much more is true. Let k > and A be an infinite cardinal. 
We say that A is k-RP if and only if A is uncountable and for all functions 
/: Sk(X) —> 2, / is constant on a subset of A of cardinality A. (RP stands for 
"Ramsey property" ) 

Theorem 2.4. Let X be an infinite cardinal. Then X is 2-RP if and only 
if X is k-RP for all k > 1. If X is 2-RP, then X is strongly inaccessible, and 
there are X many strongly inaccessible cardinals below X. 

For proofs and historical discussion, see [Ka94, p. 76]. 

Theorem 2.5 ([Ba75]). Let X be a subtle cardinal. Then X is 2-RP and 
there are X many 2-RP cardinals below X. 

Thus the k-KP does not carry us even up to subtle cardinals. However, 
we now consider the fc-SRP. Let k > and A be an infinite cardinal. We say 
that A is /c-SRP if and only if for all functions /: Sk(X) — > 2, / is constant on 
some Sk(E), where E is a stationary subset of A. (SRP stands for "stationary 
Ramsey property") 

Theorem 2.6 ([Ba75]). Let k > and X be an infinite cardinal. Then X 
is {k — l)-ineffable if and only if X is regular and /c-SRP. 
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We now present analogous definitions in terms of regressive functions 
f:Sk(X) — > A. These definitions are simpler, since they involve only the con- 
stancy of /. 

Let k > 0. A is fc-subtle' if and only if 

(i) A is an infininte cardinal; 

(ii) For all closed, unbounded CCA and regressive /: Sfc(A) — > A, there exists 
A G S'fc + i(C) such that / is constant on S}~(A). 

A is /c-almost ineffable' if and only if 

(i) A is an infinite cardinal; 

(ii) For all regressive f:Sk(X) — > A, there exists an A C A of cardinality A 
such that / is constant on Sk{A). 

A is k- ineffable' if and only if the following hold: 

(i) A is an infininte cardinal; 

(ii) For all regressive /: Sfc(A) — > A, there exists a stationary iCA such that 
/ is constant on Sk(A). 

Note that fc-ineffable' immediately implies fc-SRP. 

Theorem 2.7 ([Ba75]). Let k > and A 6e an infinite cardinal. \ is k- 
subtle if and only if A is (k + l)-subtle'; A is k-almost ineffable if and only if A 
is (k + 1) -almost ineffable'; A is k-ineffable if and only if X is (k + 1) -ineffable 1 . 

Actually, there is excess set theoretic baggage in even the three defini- 
tions just given as well as in /c-SRP. We give a number of less set theoretic 
formulations. These results are due to the author and will appear in [Free]. 

Let a be an ordinal and k > 0. We say that a is purely fc-subtle if and 
only if 

(i) a is an ordinal; 

(ii) For all regressive /: Sfc(a) — > a, there exists A G S , / t + i(a\{0, 1}) such that 
/ is constant on Sk(A). 

Here \ denotes set theoretic difference. Note that we have already removed 
the use of closed unbounded sets in this definition. 

Observe that this concept is upward closed in the sense that if a is purely 
^-subtle and a < (3, then (3 is purely fc-subtle. This is not true for any of the 
earlier concepts. 

Why do we write a\{0, 1} instead of a or a\{0}? Because then u> + k 
would be fc-subtle for all k > 0, which is hardly a large cardinal property. 

Theorem 2.8. Let k > 1. The least purely k-subtle ordinal {if it exists) 
= the least k-subtle' cardinal = the least (k — 1) -subtle cardinal. The least 
purely 1-subtle ordinal is uj + uj + 1 . 

We now distill pure fc-subtlety down even further. 

Let a be an ordinal and k > 0. We say that a is fc-large if and only if 
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(i) a is an ordinal; 

(ii) For all regressive /: a k — > a, there exist 1 < (3\ < ■ ■ ■ < 0k+i such that 

f(Pi,...,Pk) = f (&,■■■, Pk+i)- 

Note that this concept is also upward closed. 
Obviously, every purely fc-subtle ordinal is fc-large. 

Theorem 2.9. (i) Let k > 0. An ordinal is k-large if and only if it is 
purely k-subtle; 

(ii) The least k-large ordinal (if it exists) = the least purely k-subtle ordinal; 
(hi) Let k > 1. The least k-large ordinal (if it exists) = the least purely k-subtle 

ordinal = the least k-subtle' cardinal = the least (k — 1) -subtle cardinal] 
(iv) The least 1 -large ordinal = the least purely 1- subtle ordinal = u + u + 1. 

Thus the least 2-large ordinal is the least subtle cardinal. 
We now go further and remove even the mention of ordinals. 
Let (X, <) be a linear ordering with no endpoints, and k > 0. We say that 
f:X k — > X is regressive if and only if it obeys the inequality f(x) < min(x). 
We say that (X, <) is fc-critical if and only if 

for all regressive /: X k — > X, there exist &!<•••< b^+i 

such that f(bi, . . . , b k ) = f(b 2 , b k+1 ). 

Theorem 2.10. Let k > 1. The cardinality of every k-critical linear 
ordering is a k-large cardinal, and a purely k-subtle cardinal. The least car- 
dinality of a k-critical linear ordering (if it exists) = the least purely k-subtle 
ordinal = the least k-subtle 1 cardinal = the least (k — 1) -subtle cardinal. The 
least cardinality of a 1- critical linear ordering is lo±. 

We now have a number of formulations of the large cardinal hypothesis 
used in Part 4 to prove Theorems A-D: 

Theorem 2.11. The following are provably equivalent within ZFC. 
for all k > there exists a subtle (almost ineffable, ineffable) cardinal; 
for all k > there exists a A;-SRP cardinal; 

for all k > there exists a subtle' (almost ineffable' , ineffable') cardinal; 
for all k > there exists a purely k-subtle ordinal; 
for all k > there exists a k-large ordinal; 
for all k > there exists a k-critical linear ordering; 
there exists an ordinal which is purely k-subtle for all k > 0; 
there exists an ordinal which is k-large for all k > 0; 
there exists a linear ordering which is k-critical for all k > 0. 
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3. Function assignments 

We present a thorough discussion of the conditions on function assign- 
ments first shown in the introduction. We then give some elementary implica- 
tions between the different forms of Propositions A-D from the introduction. 

Recall the following introductory concepts: function assignment, ^de- 
creasing, lex ^-decreasing, < c , strict order, upward order, and <i,<2-#- 
decreasing. 

In the statement of all lemmas and definitions in this section, we let k > 0, 
X be a set, U be a function assignment for X k , <, <i, <2 be strict orders 
on X k , x G X k , and A, B, C be finite subsets of X k , f: A -> A, g: B -> B, 
h:C -f C. 

When we state theorems, we will reintroduce the objects needed for that 
theorem and not rely on the data in the previous paragraph. 

We write A C< B if and only if A C B, and ^4 is downward closed in B; 
i.e., A C i? and for all x G ^4 and y £ B,ii y < x, then y £ A. 

We say that x is a <-minimal element of ^4 if and only if i G A, and for 
no y € A is y < x. 

Lemma 3.1. If A is nonempty, then A has a <-minimal element. B can 
be written as {xi, . . . ,x n } without repetition, where for no i < j is it the case 
that Xi > Xj. The relation C< is transitive. A C< B if and only if A C B and 
for all x G B, A Q < AU {x}. 

Proof. Let A be nonempty. Define a sequence xi,X2, . . . , where x\ G A 
and Xj+i is chosen to be an element of A that is < x«, where the sequence 
terminates if it is no longer possible to continue. By the transitivity and 
irreflexivity of <, we see that no element repeats. Since A is finite, we must 
terminate. The last element is obviously a <-minimal element of A. 

Assume B is nonempty and define x\ to be any minimal element of B. In 
general, define Xj+i to be any minimal element of B\{x\, . . . , x{\, provided this 
difference is nonempty. Clearly this is an enumeration of B without repetition. 
Now let i < j. then Xj G B\{xi, . . . , Xj_i}. Since minimal element of 

B\{x\, . . . , Xj_i}, we see that x« > Xj is impossible. 

Suppose AQ< B and B C< C. Then ACC. Now let x G A and y G C 
and y < x. Then x £ B, and so y € B. Hence y G A. 

Suppose A C< B and x G B. We claim A C< A U {x}, since this is an 
obvious weakening of A C< B. On the other hand, suppose A C B and for all 
x G -B\A, 4C < iU {x}. Let y G A, z G -B, and z < y. Since vl C< A U {z}, 
we have z £ A. This completes the proof. □ 
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We say that U is singly <-end-preserving if and only if for all finite A C X k 
and x G X k , if A C< A U {x}, then U(A) C B(,4 U {x}). 

We say that U is < -end-preserving if and only if for all finite A C < B C 
X k , U(A) C B(B). 

Lemma 3.2. B is <- end-preserving if and only if U is singly <- end- 
preserving. 

Proof. Let A Q< B C\ N k be finite. Write B\A = {xi,...,x n }, where 
for all 1 < i < n, A Q < A U {x^}, and for all 1 < i < j < n, —*Xi > Xj. 
Then for all 1 < i < n, A U {x±, . . . , Xj_i} C< A U {xi, . . . , x{\. Since B is 
singly <-end-preserving, we see that for all 1 < i < n, U(A U {x\, . . . , Xj_i}) C 
[/(A U {xi, . . . , xj). Therefore B(4) C f/(£) as required. □ 

We write / (<i, <2)* g if and only if for all x G A n B, 
if for all y G A, y <i x implies /(y) = y(y), 
then /(x) = y(x) or f(x) > 2 y(x). 
We say that B is <\, <2 — *-decreasing if and only if for all finite A, B C 
X k , U(A) (<i,< 2 )* U(B). 

We say that B is singly <i, <2 — *-decreasing if and only if for all finite 
A C X k and x G A fc , we have B(A) (<i, < 2 )* U(A U {x}). 

Lemma 3.3. IfU is <i, < 2 —^-decreasing, then U is <±- end-preserving. 

Proof. Let B be as given. By Lemma 3.2, it suffices to show that B 
is singly <i-end-preserving. Accordingly, assume that A C <1 A U {x}, where 
x g" A Then x is not <i any element of A. Hence clearly U (A) C U (Au{x}). □ 

Lemma 3.4. Suppose U is <-end-preserving, A C £?, y G A, and no 
e/ement of B\A is < y. Then U{A)(y) = B(B)(y). 

Proof. Let C = {z G B: z < y or z = y}. Then C C< £?. Also we claim 
C = {z G A: z < y or z = y}. To see this, let z G C. Now z G B\^4 is 
impossible by hypothesis. Hence z £ A. 

We therefore have C C. < A. By <-end-preserving, we have B(C) C B(A) 
and B(C) C [7(B). Since y £ A, B, and C, we have B(A)(y) = B(B)(y). □ 

Lemma 3.5. 7/ [7 is <i,< 2 — # -decreasing, then U is singly <i,< 2 — *- 
decreasing. 

Proof. Let {/ be <i,< 2 — ^-decreasing. We must show that U{A) 
(<i,< 2 )* B(,4U{x}). 

Let y G ^4 be such that for all z G A with z <i y, we have U(A)(z) = 
U(A U {x})(z). We must show that U(A)(y) > 2 B(A U {x})(y) or U(A)\y) = 
U(A U {x})(y). By Lemma 3.3, B is <i-end-preserving. 
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According to Lemma 3.4, we can assume, without loss of generality, that 
some element of A U {x}\A is <i y. That is, we can assume, without loss of 
generality, that x <\ y. 

Let B = {z G A: z <i y or z = y}. Then B C <1 A. We claim that 
B U {x} C <1 A U {x}. To see this, let w G A\B\{x}, w <i z, z G B U {x}. If 
z G B, then this is a contradiction. However, if z = x, then w <i z = x <\ y, 
and so u> G B, which is again a contradiction. 

Since U is <i,<2 — ^-decreasing, we obtain the disjunction U{B) C 
£/"(.BU{x}) or there exists z > x such that U(B)(z) > 2 U(BU{x})(z). Since J7 
is <i -end-preserving, we see that U(B) C f/(-A) and [/(.BU{x}) C U(Au{x}). 
If the first disjunct holds, then U(B)(y) = U(B U {x})(y) = U(A)(y) = 
U(A U {x})(y), and we are done. If the second disjunct holds, then fix z 
such that U(B)(z) >2 U(B U {x})(z). If z = y, then we are done. Assume 
z ^ y. Then since 2 G -B, we have z <i y and z G A. By the choice of y, we 
have C/(^4)(z) = U(A U {x})(z), which is a contradiction. This completes the 
proof. □ 

Lemma 3.6. Suppose A C 5 C C, f (<i,<2)* 5 and 5 (<i,<2)* 
Furthermore, suppose that g and h agree on B\A. Then f (<i, <2)* h. 

Proof. (See notation from the third paragraph of this section.) Let x G A 
be such that for all y G A with y <i x, we have /(y) = 

First suppose that for all y G A with y <i x, we have f(y) = g(y). Then 
for all y G A with y <i x, we have g(y) = h(y). Hence for all y G B with 
y <i x, we have y(y) = /i(y). Hence y(x) = /i(x) or g(x) >2 /i(x). But also 
/(x) = y(x) or /(x) >2 y(x). Hence /(x) = h(x) or /(x) >2 /i(x) as required. 

Now assume that for some y G A with y <i x, /(y) 7^ y(y). Fix z to be a 
<i-minimal element of ^4 such that z <i x, /(z) / g(z). Then /(z) >2 5(z). 
By minimality, for all w G A with iw <i z, we have /(tf) = g(w). Hence for all 
w G B with u> <i z, we have y(w) = h(w). Hence g(z) = h{z) or g(z) >2 /i(z). 
Therefore, /(z) >2 /t(z). But since z <i x, we have /(z) = /t(z). This is a 
contradiction. □ 

Lemma 3.7. If U is <i,<2 —^-decreasing and A C B, then U{A) 
(<i,< 2 )* 

Proof. By Lemma 3.1, write 5\A = {xi, . . . , x n }, where for no i < j is 
Xi >i Xj. We show by induction on i that U(A) (<i, < 2 )*t/(^4U {xi, . . . , Xj}). 
By Lemma 3.5, this is true for % = 1. Suppose this is true for 1 < i < n. 
By Lemma 3.5, U(A U {xi, . . . ,x,}) (<i, < 2 )* U(A U {xi, . . . ,x i+ i}). Now we 
claim that U(Au{x\, . . . , Xj}) and U(A(J{xi, . . . , Xj+i}) agree on {xi, . . . , Xj}. 
This follows from Lemma 3.4 since Xj + i is not <i any element of {xi, . . . , x{\. 
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Hence we can apply Lemma 3.6 to obtain U(A) (<i, <2)* U (Au{xi, . . . , Xj+i}) 
as required. □ 

Lemma 3.8. If U is <i,<2 — # -decreasing, then U is <i,<2 —*-de- 
creasing. 

Proof. Let A, B C N k be finite, x e Af] B, and for all y G A, y <i x 
implies U(A)(y) = U(B)(y). Let A' = {z £ A: z <\ x or z = x}, and let 
B' = {z G B:z <i x or z = x}. Then 4'CB'. By Lemma 3.7, ?7( J 4')(<i: <2)* 
U(B'). Note that A' C <x A and 5' C <x B. Hence by Lemma 3.3, U(A') C 
17(A) and f/(B') C [7(B). Therefore, x G i' fl B' and for all y e A' , y <i x 
implies t/(A')(y) = U{B'){y). Hence C/"(A')(x) = U(B')(x) or C/"(A')(x) > 2 
U{B'){x). Therefore, £/(A)(x) = U{B){x) or f7(A)(x) > 2 17(B) (x). □ 

Lemma 3.9. 7/J7 is <i,<2 —* -decreasing, then U is <\- end-preserving. 

Proof. Let A C <:1 Au{s}. By Lemma 3.2 it suffices to show that U(A) C 
J7(AU {x}). Assume this is false, and let y be a <i-minimal element of A such 
that U(A U {x})(y) / C/(A)(y). Now x £ A and ^x <i y. Therefore, 

(i) y G A n (A U {x}) and for all z € A, z <i y implies U(A)(z) = 
U(AU{x})(z); 

(ii) y G (AU{x})(~lA and for all z G iU{s}, z <i y implies U(AU{x})(z) = 
U(A)(z). 

Hence by <i, <2 — *-decreasing we see that 

(iii) U(A)(y) = U(A U {x})(y) or U(A)(y) > 2 *7(A U {x})(y); 

(iv) C/(A U {x})(y) = C/(A)(y) or [/(A U {x})(y) > 2 l/(A)(y). 

Hence, C/(A)(y) = [/(A U {x})(y), which is a contradiction. □ 

Theorem 3.10. Let k > 0, X be a set, <i, < 2 5e sirici orders on A fe , 
and U be a function assignment for X k . Then U is <i, <2 — #- decreasing if 
and only if U is <i,<2 —*- decreasing. If U is <i,<2 — # -decreasing, then U 
is <i- end-preserving. 

Proof. The forward direction is by Lemma 3.8. Now suppose that £7 is 
<i,<2 — *-decreasing. Let A C A fc be finite and x G A fc . Assume that 
->U(A) C [/(A U {x}). We need to find y >i x such that £/(A)(y) > 2 
!7(AU{x})(y). 

Let y be a <i minimal element of A such that U(A)(y) U(AU {x})(y). 
Then ?7(A)(y) = U(A U {x})(y) or U(A)(y) > 2 [/(A U {x})(y). Hence 
U{A){y) > 2 *7(Au{x})(y). 

Now by Lemma 3.9, U is <i-end-preserving. Hence by Lemma 3.4, we 
see that x <i y. This completes the proof of the reverse direction. The final 
statement is from Lemmas 3.8 and 3.9. □ 
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We now consider the various forms of Propositions A-D. 

Lemma 3.11. (i) Proposition A for ^-decreasing is equivalent to Propo- 
sition B for decreasing; 

(ii) Proposition A for lex decreasing is equivalent to Proposition B for lex 
#- decreasing; 

(iii) Proposition C is equivalent to Proposition D; 

(iv) Proposition C implies Proposition A /or decreasing and for lex #- 
decreasing. 

Proof. The reverse implications in i), ii), iii) are immediate since if U is a 
function assignment for N k , then the restriction of U to subsets of any [n] k is 
a function assignment for [n] k . 

The forward implications in (i) , (ii) , (iii) are all proved by a finitely branch- 
ing tree argument, where we fix A;, p, and assume that the antecedent is true for 
k, p, and that the consequent is false. We consider the infinite finitely branch- 
ing tree of function assignments (and upward orderings) for the [n] k which are 
counterexamples. There must be an infinite path, which yields an appropri- 
ate function assignment (and upward orderings), to which we can apply the 
antecedent to obtain the required contradiction. 

For (iv), note that Proposition A for ^-decreasing is equivalent to Propo- 
sition C for <i=<2= the ordering given by \x\ < \y\. Also Proposition A for 
lex ^-decreasing is equivalent to Proposition C for <i=<2=<icx- □ 

We now wish to show that Proposition A for lex ^-decreasing implies 
Proposition A for ^-decreasing. Before dealing directly with function assign- 
ments, we need the following lemma: 

Lemma 3.12. Let c,k>0 and U be a function assignment for N k . Sup- 
pose that for all p > 0, some U (A) has at most c regressive values on some 
E k C A, \E\ = p. Then for all p > 0, some U{A) has at most k k regressive 
values on some E k C A, \E\ = p. In fact, k k can be replaced by ot(fc). 

Proof. Let c, k, U be as given. Let p > 0. Choose q 3> c,k,p. Let U(A) 
have at most c regressive values on E k C A, \E\ = q. Let t G N k not be 
a regressive value of U(A) on E k . Define g: E k — > N by g(x) = U(A)(x) if 
|Z7(A)(x) | < min(x); t otherwise. By the Finite Ramsey Theorem, let E' C E, 
\E'\ = p, be homogeneous for g. Then U(A) has at most ot(k) regressive values 
on E' k , as required. □ 

Let U be a function assignment for N k . We say that U is ^-decreasing if 
and only if U is <i, <2 — ^-decreasing, where <i=<2 is given by \x\ < \y\. By 
Theorem 3.10, U is ^-decreasing if and only if U is *-decreasing. 
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Lemma 3.13. Proposition A for lex decreasing implies Proposition A 
for decreasing. 

Proof. Assume Proposition A for lex ^-decreasing. Let U be a #-decreas- 
ing function assignment for N k . We now construct a lex ^-decreasing func- 
tion assignment V for N k+1 as follows. Let A C N k+1 be finite. Let A' = 
{x G N k : (\x\,x) G A}. Define V(A):A -> A as follows. For (|x|,x) G A, 
let V(A)(\x\,x) = (\U(A')(x)\,U(A')(x)). For the remaining y e A, let 

n^)(y) = y- 

We now show that V is lex ^-decreasing. By Theorem 3.10, it suffices to 
prove that V is lex *-decreasing; i.e., <i cx ,<icx — *-decreasing. To this end, 
let A, B C N k+1 be finite, y G A n £, and 

for all z G A with z <i cx y, F(A)(z) = V(B)(z), 

and < lcx 

Clearly y is of the form (\x\,x). Hence V(A)(y) = (|t7(A')(x)|, U{A'){x)) 
and = U{B'){x)). Therefore, U(A')(x) + U(B')(x). 

We now claim that for all w G A' with \w\ < \x\, U(A'){w) = U(B')(w). 
Suppose \w\ < \x\ and U{A')(w) + U{B')(w). Then 

V(A)((\w\,w))^V(B)((\w\,w)), 

which contradicts the previous paragraph. Also x G A' n B' (since y G A (IB). 

Now since [7 is ^-decreasing, U is also *-decreasing, and hence |J7(j4')(a;)| 
> \U(B')(x)\. Therefore V(A)((\x\,x)) >i cx V(B)((\x\, x)), which is the de- 
sired contradiction. 

We have now shown that V is a lex ^-decreasing function assignment for 
N k+1 . Then for all p > 0, some V(A) has at most (k + 1) + regressive values 
on some E k+l , \E\ = p. Let p > and fix such A, E. 

We claim that if y is a regressive value of U(A') on E k , then (\y\,y) is a 
regressive value of V(A) on S fc+1 . To see this, let U(A')(w) = y, \y\ < mm(w), 
w G E k . Then V(A)((\w\,w)) = (\y\,y), and (\w\,w) G 

From this we conclude that the number of regressive values of U (A 1 ) on 
E k is at most the number of regressive values of V(A) on E k+1 . Hence U(A') 
has at most (k + l) k+1 regressive values on some E k+l C A 1 , \E\ = p. 

Since p is arbitrary, we can now apply Lemma 3.12 with c = (k + l) k+1 
to obtain Proposition A for ^-decreasing (even with k k replaced by ot (£;)). □ 

Theorem 3.14. Proposition C implies all forms of Propositions A-D. 
Proposition A for ^-decreasing is implied by all forms of Propositions A-D. 
All forms of Proposition A-D remain equivalent if k k is replaced by ot(k). 

Proof. The first claim is from Lemma 3.11. The second claim follows 
from Lemmas 3.11 and 3.13. The third claim for Propositions A, C follows 
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from Lemma 3.12. Then derive the appropriate equivalences of A with B, and 
C with D, as in Lemma 3.11 (i), (ii). □ 



4. Proofs using large cardinals 

The goal of this part is to prove all forms of Propositions A-D from ZFC + 
"there exists a suitably large cardinal." According to Theorem 3.14 we need 
only prove Proposition C. 

For clarity, we first prove Proposition A for ^-decreasing function assign- 
ments. 

We make heavy use of Theorem 3.10. In particular, we use that if U is 
#-decreasing, then U is *-decreasing and end-preserving. These concepts are 
of course in the context of underlying set X = (N, <), where <i=<2 is the 
strict order on N k given by \x\ < \y\. 

In the treatment of function assignments for X k in Part 3, we did not use 
a linear ordering of A. In fact, if U is a function assignment for X k , then 
we can always recover the set X from U by setting X to be the union of the 
domains of the elements of X. 

In this section, we will make use of a linear ordering on X. However, in so 
doing, we will not be able to recover the linear ordering of X from the function 
assignment. Consequently in this section, we use function assignments with 
additional structure as follows. 

A linearly ordered function assignment is a triple ( X k ,<,U), where < is 
a linear ordering on the set X, and U is a function assignment for X k . For 
x € X k , we write \x\ for the maximum coordinate of x. 

We fix two linearly ordered function assignments (X k ,<,U) and 
(Y k ,<>,V). 

We say that a partial function /: X — ► Y is order-preserving if and only 
if for all a, b € X, a < b if and only if f{a) <' f(b). 

Let h: A — ► B, where A C X and B CF. Then h naturally extends to a 
function from A k into B k by h(x\, . . . , = (h(xi), . . . , h(xk))- 

Now assume that A, B are finite subsets of X k , Y k , respectively. We write 
fld(A) for the set of all coordinates of elements of A. We say that h is an order 
isomorphism from A onto B if and only if h is an order-preserving bijection 
which maps fid (A) onto fid (B) such that h maps A onto B. We say that A, 
B are order isomorphic if and only if there exists an order isomorphism from 
A onto B. If an order isomorphism exists, then it is unique. 

We say that / is a finite endomorphism in X k if and only if dom (/) is a 
finite subset of X k and rng (/) C dom (/). We say that a finite endormorphism 
/ in X k is order isomorphic to a finite endormorphism g in Y k if and only if 
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their graphs, as subsets of X 2k and of Y 2k , are order isomorphic. Clearly, if /, 
g are order isomorphic, then the unique order isomorphism must be the order 
isomorphism between their domains. 

We say that h is an order isomorphism from (X k , <, U) onto (Y k , <', V) 
if and only if 

(i) h is an order isomorphism from (X, <) onto (Y, <'); 

(ii) For all A C X k , U(A) is order isomorphic to V(h[A}) by h\M(A). 

We say that (X k , <, U) and (Y k , <', V) are order isomorphic if and only 
if there is an order isomorphism from (X k , <, U) onto (Y k , <', V). 

Let S C X. We write (X k ,<,U) \ S for (S k , <',U'), where <' is the 
intersection of < with S 2 , and U' is the restriction of U to finite subsets of S k . 

Let p £ N and E Q X. We say that (X k , <, U) is p-uniform on E C X 
if and only if for all S, T C £7 of the same cardinality < p, (X k , <,U)\S is 
order isomorphic to (X k ,<,U) \ T. We say that (X k ,<,U) is p-uniform if 
(X k , <,U) is p- uniform on X. 

We say that (X k ,<,U) is uniform if and only if it is p- uniform for all finite 
p. We always strive to obtain uniformity. 

We say that (Y k , <', V) is finitely conservative over (X k , <, U) if and only 
if for all finite S CY there exists finite TQX such that (Y k , <', V)\S is order 
isomorphic to (X k , <, U)\T. 

We say that (X k , <, U) and (Y k , <', V) are finitely equivalent if and only 
if they are finitely conservative over each other. 

Obviously, if (Y k , <', V) is finitely conservative over (X k , <,U), then every 
V(A) is order isomorphic to some U(B); however, the converse seems to fail. 
Also, if (X k , <, U) and (Y k , <', V) are finitely equivalent, then every U(A) is 
order isomorphic to some V(B) and every V(A) is order isomorphic to some 
U(B); the converse also seems to fail. 

An infinite linearly ordered function assignment is a linearly ordered func- 
tion assignment whose first component, X k , is infinite. 

Lemma 4.1. Let U* = (X k , <, U) be an infinite linearly ordered function 
assignment. Let p G N, and E C X be infinite. Then there is an infinite 
E' C E such that U* is p-uniform on E. 

Proof. This is an immediate consequence of Ramsey's theorem once we 
check that for all i < p, the equivalence relation "U*\S order isomorphic to 
U*\T V for \S\ = \T\ = i has finitely many equivalence classes. But we can give 
a concrete representation of the equivalence classes as follows. Given U*\S, 
we can list the elements of S in increasing order, and define the appropri- 
ate finite set of endomorphisms using indices as domain and range elements. 
Clearly C/* | S' is order isomorphic to U*\T if and only if the corresponding set of 
functions for U*\S is the same as the corresponding set of function for U*\T. □ 



828 



HARVEY M. FRIEDMAN 



Theorem 4.2. Let k > and U* be an infinite linearly ordered function 
assignment. Then there is an infinite uniform linearly ordered function assign- 
ment V* which is finitely conservative over U* . In fact, V* can be taken to be 
of the form (N k , <, V), where < is the usual linear ordering of N . 

Proof. Let U* = (X k ,<,U). We define infinite sets X = E D E x D 
Ei . . . as follows. For i > 0, Ei C Ei-\ is chosen so that U* is i-uniform on E{. 

We now define the function assignment V* for N k . Let A C N k be finite. 
We wish to define V(A). Let S = fid (A), \S\ = p. Let T C E p , \T\ = p. Let 
W* be the unique linearly ordered function assignment (S k ,<,W) which is 
order isomorphic to U*\T. Take V(A) = W(A). Define V* = {N k , <,V). 

We need to verify that V* is well defined, i.e., is independent of the choice 
of T. But this is clear from the p-uniformity of U* on E p . 

We now verify that V* is uniform. Let S,T C N have cardinality p > 0. 
Let h be the unique order isomorphism from S onto T. We need to verify that 
h is an order isomorphism from V*\S onto V*|T. Let A <Z S k . It suffices to 
show that h is an order isomorphism from V(A) onto V(/iL4]). But for this, 
it suffices to know that V(A) and F(ft,L4]) are order isomorphic. But this is 
clear since the construction of V* is well defined. 

Now let S C N, |fld(S)| = p. Let \T\ = p, T C E p . We claim that V*\S 
is order isomorphic to U*\T. To see this, let h: S — > T be order-preserving, 
and let yl C S'^, |fld(^4)| = (?. We must show that V(A) is order isomorphic 
to U(h[A]). Now by construction, V(A) is order isomorphic to some U(B), 
B C S*, |fld(B)| = g. Since C ^ C S*, |fld(/i[A])| = q, we see that 
U(h[A]) is order isomorphic to U(B) and V(-A). □ 

Let U* = (X k , <,U) be a linearly ordered function assignment. We say 
that U* is ^-decreasing if and only if for all finite A C X k and x G 

either U(A) = U(AU {x}), or there exists \y\ > \x\ 

such that \U{A)(y)\ > \U{A U {x})(y)\. 

We say that U* is ^-decreasing if and only if for all finite A,BC X k and 

x e AnB, 

if for all y £ A, \y\ < \x\ implies U(A)(y) = U(B)(y), 

then U{A){x) = U{B)(x) or \U(A)(x)\ > \U(B)(x)\. 

In the above, < refers to < on 1, and | | is the sup, which also refers to < 
on X. Note that if X = N and < is the usual linear ordering on N, then U* 
is ^-decreasing (*-decreasing) if and only if U is ^-decreasing (^-decreasing). 

Lemma 4.3. Let U* and V* be linearly ordered function assignments, 
where V* is finitely conservative over U* . If U is ^-decreasing, then V is 
decreasing. 
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Proof. Note that U* or V * is ^-decreasing if and only if every finite U* \ S 
or V*\S is ^-decreasing, and ^-decreasing is an order theoretic property. □ 

Lemma 4.4. Let U* be an infinite ^-decreasing linearly ordered function 
assignment. Then there is a uniform infinite decreasing linearly ordered 
function assignment V* which is finitely conservative over U* . Furthermore, 
V* can be taken to be of the form {N k ,<,V), where < is the usual linear 
ordering of N. 

Proof. This is immediate from Theorem 4.2 and Lemma 4.3. □ 

We say that (X k , <,U) is order invariant if and only if for all finite order 
isomorphic A, B C X k , U{A) is order isomorphic to U{B). 

Lemma 4.5. A linearly ordered function assignment is uniform if and 
only if it is order invariant. 

Proof. Let U* = {X k ,<,U) be uniform. Let A,B C X k be finite and 
order isomorphic, with respective fields S, T. Now U* \ S and U* \ T are order 
isomorphic. The unique order isomorphism must send A to B. Hence U(A) 
and U(B) are order isomorphic. 

Now let U* = (X k ,<,U) be order invariant. Let S, T be finite subsets 
of X of the same cardinality. Let h be the unique order-preserving bijection 
from S onto T. Let A Q S k . We must show that U(A) is order isomorphic to 
U(h[A]). But this is immediate since A is order isomorphic to h[A\. □ 

Lemma 4.6. Let U* be a uniform infinite linearly ordered function as- 
signment, and let (Y, <) be an infinite linear ordering. Then there is a unique 
linearly ordered function assignment V* = (Y k , <, V) which is finitely conser- 
vative over U* . This unique V* is itself uniform and is finitely equivalent to 
U* . Furthermore, U* is ^-decreasing if and only ifV* is ^-decreasing. 

Proof. For uniqueness, let A C Y k be finite. Then V(A) must be order 
isomorphic to some U{B). Since all U(B), where B is isomorphic to A, are 
order isomorphic, V(A) is uniquely determined up to order isomorphism. But 
then V(A) is completely determined. 

The previous paragraph actually defines V and V* since U is infinite. By 
construction, V* is finitely equivalent to U*. It is also clear that V* is order 
invariant. Therefore by Lemma 4.5, V* is uniform. The remainder follows from 
the fact that U* (V*) is ^-decreasing if and only if for all finite S C X(Y), 
U*\S (V*\S) is #-decreasing. □ 

We say that / is a direct completion of U* if and only if 

(i) f:X k ^X k ; 

(ii) For all finite A C X k there exists B D A such that U(B) C /. 
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It is interesting to note that this definition depends only on X and U, and 
not on <. 

A well ordered function assignment is a linearly ordered function assign- 
ment whose < is a well ordering. 

We now wish to prove the fundamental fact that every ^-decreasing well 
ordered function assignment has a direct completion. To this end, fix a well 
ordered function assignment V* = (X k , <, V) which is ^-decreasing. 

We say that / is special if and only if 

(i) / is a partial function from X k into X k such that for all y G dom (/) 
and \x\ < \y\, we have x G dom(/); 

(ii) For all finite A C dom (/) there exists B D A such that U(B) C /. 
For A C X k , we say that x is minimal over A if and only if x G X k \A, 

and for all \y\ < \x\, y G A. 

Lemma 4.7. Let f be special and x G X k be minimal over dom (/). Then 
there exists y G X k such that f = f U {(x,y)} is special. 

Proof. Let y be any element of {^(^4 U {x})(x):V(A) C /} of minimal 
sup. We claim that /' = /U {(x, y)} is special. Clearly dom (/') is as required. 
Now fix A C dom (/) such that V(A) C / and V{A U {x})(x) = y. Note that 
x A. 

Now let B C dom (/') be finite. It suffices to find D D S such that 

y(z?) c /'. 

Since / is special, let C D A U S\{x}, where V(C) C /. Hence V(A) C 
V(C). Now by Theorem 3.10, F is <,< — *-decreasing and <-end-preserving, 
where < is the relation \a\ < \b\. Hence V(A) C y(Au{x}) and F(C) C y(CU 
{x}). By ^decreasing, V(Au{x}) (<,<)* y(CU{x}). Hence V(Au{x})(x) = 
V(CU{x}){x) or |V(AU{x})(x)| > \V(CU{x})(x)\. That is, y(CU{x})(x) = y 
or U {x})(x)| < \y\. In the former, we have V(C U {x}) C /', in which 

case we are done by setting D = C LI {x}. The latter case is impossible by the 
minimality of y. □ 

Theorem 4.8. Every ^-decreasing well ordered function assignment has 
a unique direct completion. 

Proof. It suffices to prove that V* has a unique direct completion. Note 
that the empty function is special, and the special functions are closed under 
unions of chains. Since X is well ordered, for all proper subsets B of X k there 
exists x G X which is minimal over B. Hence by Lemma 4.7, any maximal 
special function is a completion of V on X. By Zorn's lemma there exists a 
completion of V* on X. 

For uniqueness, let /, g be distinct direct completions of V* and let x be of 
minimal sup such that f(x) / g(x). Let x G A, where U(A) C /. Let BDi, 
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where U(B) C g. Then by *-decreasing, we see that U(A)(x) = U(B)(x) or 
\U{A){x)\ > \U(B)(x)\. Hence f(x) = g{x) or \f(x)\ > \g(x)\. Now we can 
interchange /, g in the above argument, and obtain g(x) = fix) or \g{x)\ > 
\f(x)\. Hence f{x) = g(x), which is the desired contradiction. □ 

We now consider the more general concept of completion. 
Let U* be a linearly ordered function assignment and Y be a linearly 
ordered set. We say that / is a completion of U* on Y if and only if 

(i) / : y*-y* ; 

(ii) For all finite B (ZY k there exists B C C CY k such that / | C is order 
isomorphic to some U(A). 

Note that this concept of completion makes perfectly good sense for func- 
tion assignments U for N k , since we can view U as the linearly ordered function 
assignment U* = (N k , <,U), where < is the usual linear ordering on N. 

We say that U* has the (unique) ordinal completion property if and only 
if U* has a (unique) completion on every well ordered set. 

We say that a function assignment U for N k has the (unique) ordinal 
completion property if and only if U has (unique) completions on every well 
ordered set. 

Theorem 4.9. Every infinite ^-decreasing linearly ordered function as- 
signment has the ordinal completion property. For all k>0, every ^-decreasing 
function assignment for N k has the ordinal completion property. Furthermore, 
if the assignment in question is uniform, then the unique ordinal completion 
property holds. 

Proof. For the first claim, let U* = (X k , <,U) be an infinite ^-decreasing 
linearly ordered function assignment and Y be a well ordered set. If Y is finite, 
then it is obvious that there is a completion of U* on Y. If Y is infinite, then by 
Lemma 4.4, there exists a ^-decreasing linearly ordered function assignment 
V* = (Y k , <,V) which is finitely conservative over U*. By Theorem 4.8, V* 
has a direct completion. Clearly this direct completion is a completion of U 
on Y. The second claim is a special case of the first claim. 

For the third claim, let /, g be completions of U* on Y, and let x be 
of minimal sup norm such that fix) ^ g(x). Let x € S and f\S be order 
isomorphic to U(A). Let 5CT and g\T be order isomorphic to U{B). Let h 
be the unique order isomorphism from g\T onto U{B). Let C = h[S]. Then 
clearly C is order isomorphic to A. Hence by order invariance, U(C) is order 
isomorphic to U(A). Hence f\S is order isomorphic to U(C). Furthermore, 
this order isomorphism is h\S, because h\S is the unique order isomorphism 
from S onto C. 
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We now claim that for all y G C, if \y\ < \h(x)\, then U(C){y) = 
U{B){y). Let y G C, |y| < Now C7(C)(y) = (/i^y)) and = 

h(g(h~ 1 y)). Since /i is order-preserving, \h~ 1 y\ < \x\. Hence = 
g^y). Hence l/(C)(y) = U{B){y). 

Therefore, by ^-decreasing, we have U(C){h{x)) = U{B){h(x)) or 
\U(C)(h{x))\ > \U(B)(h{x))\. Therefore, f{x)=g(x) or \f(x)\ > \g(x)\. 

We can now interchange / and g in the above argument and obtain 
g(x) = f(x) or |«7(x)| > |/(ar)|. Hence f(x) = g(x), which is the desired 
contradiction. □ 

So far we have not used any axioms beyond ZFC. We now fix k > and 
a fc-ineffable' cardinal A. For 4CA, let FST(A) be the set of all finite subsets 
of A. 

By elementary set theory, fix a one-one onto function /: FST(A) — > A. Let 
C = {x: x < A and /[FST(x)] C x}. Clearly C is closed unbounded. 

Recall from Part 1 that ot(fc) is the number of order types of elements of 
N k , and that ot(k) < k k . 

Lemma 4.10. Let g: X k — > A fc . Then there exists an infinite set BO 
such that g has at most ot (k) regressive values on B k . 

Proof. We define an auxiliary regressive function h: S'fc(A) — > A as fol- 
lows. Let A £ Sk{C). Let A fc/ be the set of all elements of A k whose set of 
coordinates form an initial segment of A. Note that \A k, \ = ot(k). Define 
h(A) = f{g(x):x G A kl and \g{x)\ < mm(A)}. For other A G S k (X), define 
= 0. 

Note that h: Sfc(A) — > A is regressive. Since A is /c-ineffable' let h be con- 
stantly c on some infinite Sk(B), where B C C. Let /(T) = c. By construction, 
|T| < ot(k). We claim that every regressive value of g on B k lies in T. To 
see this, let \g{x)\ < min(x), x G B k . Choose A G Sk(B) so that x G ^4 fe/ . 
Then h(A) = c, and so f{g(x):x G A fc ' and |c/(x)| < min(v4)} = f(T). Hence 
{g(x):x G and < mm(A)} = T. Hence g(x) G T. □ 

Theorem 4.11. Assume that for all k there exists a k-ineffable' cardinal. 

(a) Let k,p > and U* be an infinite linearly ordered function assignment 
with the ordinal completion property. Then some U(A) has at most ot (k) 
regressive values on some E k , \E\ = p. 

(b) Let k,p > and U be a function assignment for N k with the ordinal 
completion property. Then some U (A) has at most ot (k) regressive values 
on some E k , \E\ = p. 

Proof. Claim (b) is a special case of claim (a). To prove (a), let /: X k — > A fc 
be a completion of U* on A, where A is a fc-ineffable' cardinal. By Lemma 4.10, 
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let B C A, |£?| = p, and / have at most ot (k) regressive values on B k . Choose 
finite B k C D C \ k and A (1 X k such that f\D is order isomorphic to £/(A). 
Then £7(A) has at most ot (k) regressive values on some E k , \E\ = p, as 
required. □ 

Theorem 4.12. Assume that for all k there exists a k-ineffable' cardinal. 
Then Proposition A holds for ^-decreasing. 

Proof. This is an immediate consequence of Theorems 4.9 and 4.11. □ 

We now begin the proof of Proposition C. We first need to introduce some 
terminology that involves a pair of orderings. 

Recall that in Part 3, we worked with function assignments, and in this 
part we have been working with linearly ordered function assignments. We 
now add some additional structure as follows. 

An extended linearly ordered function assignment (elofa) is a quintuple 
(X k , <, <i, <2, U), where (X k , <, U) is a linearly ordered function assignment 
(lofa) and <i, <2 are strict orders on X k . Without confusion, we can treat an 
elofa as a lofa by suppressing <i and < 2, if we so specify. 

Order isomorphisms between elofa's are required to preserve the two strict 
orders, in addition to < and U. The restriction of an elofa to a set S restricts 
the strict orders to S 2 . And p- uniformity and uniformity of elofa's is defined 
using these order isomorphisms and restrictions. Finite conservativity and 
equivalence are also defined in the obvious way using these isomorphisms and 
restrictions. 

For linear orderings (X, <), we let < c be the order on X k given by x < c y 
if and only if for all i, X{ < yi. 

We say that < is upward on X k if and only if < is a strict ordering on X k 
such that for all i,j/£ X k , if x < c y then ^y < x. 

We say that an elofa (X k , <, <i, <2, U) is upward if and only if <i, <2 
are upward orders on X k . 

We also say that an elofa (X k , <,<i,<2,U) is ^-decreasing (*-decreasing, 
end-preserving) if and only if U is <i, <2 — ^-decreasing (<i, <2 — ^decreas- 
ing, <i-end-preserving). 

We emphasize the contrast between ^-decreasing lofa's and ^-decreasing 
elofa's. In the former, ^-decreasing is stated in terms of <. In the later, 
decreasing is stated in terms of <i, <2 and < plays no role. The same is true 
of *-decreasing and end-preserving. However, < is used in an essential way to 
define upward. 

Thus there is no relationship between an elofa being ^-decreasing, *- 
decreasing, or end-preserving, and it being ^-decreasing, *-decreasing, or end- 
preserving as a lofa. 
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The concepts of uniform and order invariant for elofa's are entirely analo- 
gous to the lofa context, where <i and <2 are taken into account in the obvious 
way. And the concepts of restriction, finitely conservative, finitely equivalent, 
uniform, and order invariant between elofa's is also entirely analogous to the 
lofa context, where <i and <2 are taken into account in the obvious way. 

A direct completion of an elofa is simply a direct completion of the elofa 
as a lofa. A well ordered elofa is an elofa whose < is a well ordering. 

We now wish to prove the fundamental fact that every upward #-decreas- 
ing well ordered elofa has a direct completion. To this end, fix a well ordered 
upward ^-decreasing elofa V* = (X k , <, <i, <2, V). 

Lemma 4.13. Let x\,X2,--- G X k . Then there exists i < j such that 
x% < c Xj. In fact there is an infinite subsequence such that each term is < c the 
next. 

Proof. This is a standard result from wqo theory (well quasi order theory) . 
For the sake of completeness we give a proof, which depends crucially on the 
hypothesis that (X, <) is a well ordering. 

Let x±, X2, ... be given. It is a well known consequence of (X, <) being a 
well ordering that every infinite sequence from X has an infinite subsequence 
which is increasing (i.e., each term is < the next). Choose an infinite subse- 
quence of the x's whose first coordinates are increasing. Choose an infinite 
subsequence of this infinite subsequence whose second coordinates are increas- 
ing. Repeat the process k times. □ 

Lemma 4.14. Every nonempty A C X k has a <\-minimal element; i.e., 
an x G A such that for no y G A is y < x. The same is true for <2- 

Proof. This is a consequence of the hypothesis that <i is upward on X k . 
Suppose this is false for nonempty A. Let x\ G A. Inductively define Xj+i < Xj. 
This results in an infinite sequence x±, X2, ■ ■ • such that each X{ >\ Xi+\. Hence 
for all i < j, Xj >i X{. But by Lemma 4.13, let i < j be such that X{ < c Xj. 
Then -<Xj >i Xj. This is the desired contradiction. □ 

We say that / is regular if and only if 

(i) / is a partial function from X k into X k such that for all y G dom (/) 
and x <i y, we have x £ dom (/); 

(ii) For all finite A C dom (/) there exists B containing A such that 
V(B) C /. 

Note that this is the same as the previous concept "/ is special" with 
\x\ < \y\ replaced by x <i y. 

For A C X k , we say that x is <i-minimal over A if and only if x G X k \A, 
and for all y <i x, we have y G A. 
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Lemma 4.15. Let f be regular and x be <i-minimal over dom (F). Then 
there exists y € X k such that f = f U {(x,y)} is regular. 

Proof. Let y be any <2-minimal element of {(V(^4 U {x})(x): V(A) C /}. 
Note that this set is likely to be infinite, and so we need Lemma 4.14 to obtain 
y. We claim that /' = fU{(x, y)} is regular. To see this, fix A C dom (/) such 
that V{A) C / and V(A U {x})(x) = y. 

Now let B C dom (/') be finite. It suffices to find D D B such that 
V(D) C /'. 

Since / is regular, let C D 4 U where V(C) C /. Hence V(A) C 

V(C). Now by Theorem 3.10, V is <i, <2 — *-decreasing and ^-end-pre- 
serving. Hence V(A) C FfAUja;}) and V(C) C V(CU{a;}). By ^-decreasing, 

U {x}) (<i, < 2 )* ^(C U {x}). Hence V(4 U {x})(x) = V[C U {x})(x) 
or V(A U > 2 ^((7 U {x}){x). That is, U {x}){x) = y or F(C U 

<2 y. In the former case we have V{C U {x}) C in which case 
we are done, by setting D = C U {x}. The latter case is impossible by the 
<2-minimality of y. □ 

Theorem 4.16. Every well ordered upward ^-decreasing extended lin- 
early ordered function assignment has a unique direct completion. 

Proof. It suffices to prove that V* has a unique direct completion. Note 
that the empty function is regular, and the regular functions are closed under 
unions of chains. Since X is well ordered, by Lemma 4.14 we see that for 
all B C X there exists x G X which is <i-minimal over B (here C indicates 
proper inclusion). Hence by Lemma 4.15, any maximal regular function is a 
completion of V on X. By Zorn's lemma there exists a completion of V* on 
X. 

For uniqueness, let f,g be distinct direct completions of V* and let x be 
<i-minimal such that f(x) / g{x). Let x <G A, where U(A) C /. Let BDi, 
where g \ B = U(B) C g. Then by *-decreasing, we see that U{A){x) = 
U{B)[x) or U{A){x) > 2 U(B)(x). Hence f(x) = g(x) or f(x) > 2 g(x). Now 
we can interchange /, g in the above argument, and obtain g(x) = f(x) or 
g(x) >2 f{x)- Hence f(x) = g(x), which is the desired contradiction. □ 

We say that an elofa V* has the (unique) ordinal completion property if 
and only if V* has the (unique) ordinal completion property as a lofa. 

Theorem 4.17. Every infinite ^-decreasing upward extended linearly or- 
dered function assignment has the ordinal completion property. For all k > 
and upward orders <\, <2 on N k , every <i, < 2 —^-decreasing function assign- 
ment for N k has the ordinal completion property. Furthermore, if the function 
assignment is uniform, then the unique ordinal completion property holds. 
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Proof. For the first claim, let U* be an infinite upward ^-decreasing elofa, 
and (Y, <) be a well ordered set. We can assume without loss of generality 
that Y is infinite. Analogously to Lemma 4.4, we can find a uniform infi- 
nite ^-decreasing elofa U*' which is finitely conservative over U* . By finite 
conservativity, U*' is also upward. Analogously to Lemma 4.6, we can find a 
^-decreasing elofa V* = (Y k , <, <i, <2, V) which is finitely conservative over 
U*', and hence finitely conservative over U*, and also upward. We then apply 
Theorem 4.16. 

The second claim is a special case of the first claim. 

The third claim is also proved analogously to Theorem 4.9. We simply 
replace all occurrences of < by <i, all occurrences of > by >2, and remove all 
absolute value signs. □ 

Theorem 4.18. Assume that for all k there exists a k-subtle cardinal. 
Then Proposition C holds. In fact, all forms of Propositions A-D hold, even 
with k k replaced by ot (k). 

Proof. By Theorems 2.2 and 2.7, the assumption implies that for all k, 
there exists a ^-ineffable' cardinal. Then apply Theorem 4.17, 4.11, and 3.14. □ 

5. Independence proofs 

5.1. Existence of finite solutions of certain recursive definitions with strong 
indiscernibles. We now prove that Proposition A for ^-decreasing implies the 
consistency of ZFC, and in fact Con (ZFC + {there is a ^-subtle cardinal}*;). 
By Theorem 3.14, this is enough to establish the independence of all forms 
of Propositions A-D from the theory ZFC + {there is a fc-subtle cardinally, 
assuming that this theory is consistent. 

Throughout this part, we take Proposition A for ^-decreasing as the work- 
ing assumption. Each of the eight section headings in this part describes the 
final lemma of that section. 

Let / be a nonempty partial function from N k — > N r and E C N. We 
say that / is regressively regular over E if and only if the following hold. 

(i) £ fc Cdom(/); 

(ii) Let x,y € E k be of the same order type. If \f{x)\ < min(x), then 
\f(y)\ < min(y) and f{x) = f(y). 

Lemma 5.1. Let k,p > and U be a ^-decreasing function assignment 
forN k . Then some U(A) is regressively regular over some E of cardinality p. 

Proof. Let k, p, U be as given. Choose q » k,p. Let U(A) have at 
most k k regressive values on E k C A, \E\ = q. We define G: E k —> N k by 
G(x) = U(A)(x) if \U{A)(x)\ < \x\; -1 otherwise. 
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By the choice of q, and the Finite Ramsey Theorem, let E' C E, \E\ = p, 
such that the following holds. For all x, y G E k , if x, y have the same order 
type, then G(x) = G(y). Then E' is as required. □ 

For i > and j > 0, we let i*j be the j-tuple all of whose coordinates 
are i. 

A function system U for N k is a mapping U from finite A C N k into 
functions U(A): A — > fld(A). Thus function systems are a version of function 
assignments with codimension 1. 

We wish to consider very special kinds of function systems called inductive 
function systems. 

Let FPF(A rfc ) be the set of all finite partial functions from N h into N. For 
/ G FPF(iV fc ) we let fld(/) = fld(graph(/)). 

Let DFNL(iV fc ) be the set of all H: FFF(N k ) x N k -» N such that for all 
fCg from FPF(iV fe ) and x G N k , 

(i) H(f,x)>H(g,x); 

(ii) H(f,x)eM(f)U{ Xl ,...,x k }. 

Here DFNL stands for "decreasing functional." 

Each H G DFNL(iV fe ) generates a function system U for N k by the fol- 
lowing inductive process. 

Let A C iV fc be finite. We define RCN(^, i?) as the unique F: A -> fld(A) 
such that for all .F(x) = G A: \y\ < Note that for each 

fixed H G DFNL(iV fc ), RCN(A,i7) defines a function system. We call such a 
function system an inductive function system for iV fc . Here RCN stands for 
"recursion." 

For x,y G N k , we write x C y if and only if every coordinate of x is a 
coordinate of y. 

We say that A C A^ fc is closed if and only if for all x C y with ?/ 6 i, we 
have x G A. 

Lemma 5.2. Let k,p > and [/ 6e an inductive function system for N k . 
Then there exists finite closed A such that U(A) is regressively regular over 
some E of cardinality p. 

Proof. For finite A C N h , write A' = {x G A: for all y C x, n G ^4}. We 
modify the RCN construction as follows. 

Let H G DFNL(iV fe ). Define MRCN(A,H) as the unique F:A -> fid (A) 
such that for all x £ A, F{x) = H(F\{y G A': |y| < |x|},x). We wish to show 
that MRCN(A, H) defines a function system for N k . 

For this purpose, we define H': FPF(N k ) x N k -> AT by H'(f,x) = 
H{f\{y G dom(/)': |y| < |x|},x). Note that if / C thendom(/)' C dom(y)'. 
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Hence H' G DFNL(iV fc ). And note that MRCN{A,H) = RCN(A,H'). So 
MRCN(^4, H) does define a function system for N k . 

Note that for all x G A, MRCN(A,H)(x) is either a coordinate of some 
y G A 1 with |y| < |x|, or a coordinate of x. This is proved by induction on \x\. 

Fix k, p, U as given. Fix H G DFNL(-/V fe ) so that U is the inductive 
function system given by RCN(A,H), as a function of A. It is convenient to 
define A A = {x G A: for all y C x, if |y| < |x|, then y G ^4}. 

Let V be the function assignment for N k , where V(A): A — ► A is defined 
by cases as follows. Let x £ A. 

(i) x£A A and MBCN(A,H)(x) < \x\. Define 

V(A)(x) = MRCN(A,H)(x)*k. 

(ii) Otherwise. Define V(A)(x) = x. 

To verify that V is indeed a function assignment, note that 
MRCN(A,H) (x)*k C x or C some element of A'. Hence, in (i), 
MRCN(A,tf)(x)*£: G A. 

We now claim that V is ^-decreasing. To see this, fix finite A C iV fc , 
x G iV fc , and assume ->V(A) C V(-A U {x}). Fix y G ^4 of minimal sup such 
thaty(^)(y)^y(AU{x})(y). 

Note that the value of any MRCN(B, H){y) depends only on y and the 
elements of B of norm < \y\. From this it follows that the value of any V{B)(y) 
also depends only on y and the elements of B of norm < \y\. 

Now A and A U {x} have the same elements \z\ < |x|. Hence V(A) and 
(V(A U {x}) agree at all \z\ < \x\. We have thus shown that |y| > \x\. 

We now claim that MRCN(A, H) and MRCN(A U {x},H) agree at all 
z G A' with \z\ < \y\. To see this, fix z G A', |z| < |y|. Then V(A)(z) = 
V(Au{x})(z). But = MRCN(^4, H)(z)*k if MRCN(A, H){z) < \z\; 

z otherwise. And V(A U \x})(z) = MRCN(,4 U {x}, H)(z)*k if MRCN(,4 U 
{x},H)(z) < \z\; z otherwise. Since MRCN(A,H)(z) < \z\ and MRCN(,4 U 
{x}, H)(z) < \z\, the claim is established. 

We now see that by the definition of MRCN(A, H){y) and the decreasing 
condition on H, that MRCN(A,H)(y) > MRCN(yl U {x},y). We now claim 
that |y(A)(y)| > |F(AU {x})(y)|, which completes the proof of the claim that 
V is ^-decreasing. We argue by cases. 

Recall that V(A)(y) ^ V(Au{x})(y). Note that V(A)(y) = y or \V(A)(y)\ 
< \y\, and V(A U {x})(y) = y or \V(A U {x})(y)| < \y\. 

Case 1. y G A A and MRCN(A, #)(y) < |y|. Then F(A)(y) = 
MRCN(^,if)(y)*A; and V(A U {x})(y) = MRCN(.4 U {x}){y)*k. Therefore, 
MRCN(A, H)(y) > MRCN(A U {x}, y). Hence \V(A)(y)\ > \V(A U {x})(y)|. 

Case 2. Otherwise. Then F(A)(y) = y. Hence U {x})(y)| < |y| = 
\V(A)(y)\. 
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We have thus established that V is ^-decreasing. Now fix A and \E\ = p 
such that V(A) is regressively regular on E. 

We want to prove that RCN(A', H) is regressively regular on E. This will 
complete the proof of the lemma, since obviously A' is closed. 

By examining clauses (i) and (ii), we see that for all x G A', 

MRCN(A,H)(x) = \V(A)(x)\. 

Also observe that RCN(A', H) C MRCN(A, H) by induction on the sup norm 
of x € A'. And since E k O A, we see that E k C A'. 

Now let x,y G E k be of the same order type, and RCN(A / , H){x) < 
min(x). Since x G A', MRCN(A,H)(x) < min(x). Hence V(A)(x) = 
MRCN(A,H)(x)*k and \V{A){x)\ < min(x). So V(A)(x) = V(A)(y) and 
\V(A)(y)\ < min(y). Since y G A', V{A){y) = MRCN(A, H)(y)*k. Thus 

MRCN(A,H)(x) = MRCN(A,H)(y) < min(y) . 

Hence RCN(A', H)(x) = RCN(A', H)(y) < min(y) as required. □ 

We are going to apply Lemma 5.2 to certain inductive function systems 
that are defined in logical terms. 

Let QF be the set of all propositional combinations of atomic formulas of 
the form x < y, where x and y are variables representing elements of N. We 
require that elements of QF are in disjunctive normal form. We use actual 
variables x±, X2, ■ ■ ■ ■ 

Let / G FPF(iV r ). If y G N rt , then we write f(y) for 

(f(Vl, Vr), • • • , fiVrt-r+1, • • • , Vrt)) ■ 

Here it is important to adhere to the convention that f(y) is defined if 
and only if each of the t components is defined. That is, f(y) is defined if and 
only if y G dom (/)*. 

Let BEF(q,t,r) be the set of all bounded existential formulas of the fol- 
lowing form: 

B{x) = (By Gdom(F)')(M < |s| & D(x,y, F(y))) , 

where x abbreviates the list of variables x±, . . . ,x q , y abbreviates the list of 
variables x q+ i, . . . ,x q+r t, and D is in QF. Here F is viewed as a function 
symbol representing a finite partial function from N r — > N. Note that there 
are no nested occurrences of F in B(x). 

We let BEF(g, r) be the union over t of the BEF(g, t, r). 

If we specify an actual / G FPF(iV r ) and x G N q , then it is clear what we 
mean by asserting that B(x) is true in F. 

Let B G BEF(r + l,r) and A be a finite subset of N r . We define Df(B; A) 
as the unique f:A—> fid(A) such that for all x G A, f(x) = min{j G &d(A):j = 
\x\ or B(x,j) is true in /}. 
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Lemma 5.3. Let r,p > and B G BEF(r + l,r). Then there exists 
finite closed A C N r such that Df(B;A) is regressively regular over some E 
of cardinality p. 

Proof. Let r, p, B be as given. Define H (F, x) = min{j G Rd(F) U 
{xi,...,x k }:j = \x\ or B(x,j) is true in F}. Then H G DFNL(iV fc ). By 
Lemma 5.2, let A be a finite closed subset of N k and £7 6 S P {N) such that 
RCN(^4, i7) is regressively regular on i£. 

Now for all x G A, RCN(A, #)(x) = #(RCN(A, H)\{y G A: |y| < |x|)},x). 
Since A is closed, fld(RCN(A, H)\{y G A: |y| < |x|}) = {j G M(A): j < \x\}. 
Hence RCN(A,H)(x) = mm{j G {j G fld(A): j < |x|}U{xi, . . . ,x k }:j = \x\ or 
B(x,y) is true in F}. That is, RCN(A,H)(x) = min{j G fld(A): (j = |x| 
or j G {xi,...,Xfc}) and (j = |x| or B(x,j) is true in F)}. Therefore, 
RCN(A,H)(x) = mm{j G M(A):j = |x| or -B(x,j) is true in F)}. To see 
this last step, note that we are claiming that the min over two related sets are 
equal. Note that both sets contain |x|. Also note that both sets agree below 
|x|. 

Thus we have shown that RCN(yl, H) obeys the defining condition for 
Df(B; A). Hence RCN(A, H) = Df(B; A), and this completes the proof. □ 

Let k > r > 0, / G FPF(iV fc ), and A = dom(/). We define A/r = 
{x G N r : (x, |x| * k — r) G A}, and f /r: A/r — > N by //r(x) = /(x, |x| * A; — r). 
We think of and //r as the r-dimensional parts of A and /. 

Lemma 5.4. Let A C iV fe &e closed and k > r. Then A/r is closed, and 
fld( J 4/r) = fld( J 4). Furthermore, let f:A—> fld( J 4) be regressively regular over 
E. Then f /r is regressively regular over E. 

Proof. Let A, k, r, f be as given. To see that A/r is closed, let x C y G 
A/r. Then (x, |x|*/c — r) C (y, |y|*/c — r) G A. Hence (x, |x|*/c — r) G A, and so 
x G A/r. 

Now observe that j G fld( J 4) if and only if j*k G A. Also note that 
j G fld( J 4/r) if and only if j*r G A/r if and only if j*k G A. 

Finally, to show that f /r is regressively regular over let x, y G S r have 
the same order type and / /r(x) < min(x). Then /(x, \x\*k — r) = f/r(x) < 
min(x). Now (x, \x\*k — r) and (y,\y\*k — r) are elements of E r with the 
same order type. Hence f(x, \x\*k — r) = f(y, \y\*k — r) < min(y). Therefore 
//r(x) = f /r(y) < min(y) as required. □ 

We now introduce some notation for the next lemma. Let q, t > and 
y G N qt . The coordinates of y are obviously separated into q consecutive 
blocks, each of length t. Let 1 < i < q and 1 < j < t. We let y#{i,j) be the 
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gi-tuple obtained by locating the coordinate of y in the j-th position in the 
z-th block, and replacing all succeeding coordinates of y with this coordinate. 

Lemma 5.5. Let p,q,r,t > 0, s > r, B G BEF(r + l, r), and Ci,...,C q G 
BEF(s + t,r). Then there exist finite closed A C N s+qt and f:A—> M(A) such 
that the following hold: 

(i) For all (x, \x\*s + qt — r) G A, f(x, \x\*s + qt — r) = min{j G &d(A): j = \x\ 
or B(x,j) holds in f/r}; 

(ii) Suppose that x G N s , y G N qt , \x\ < y\ < ■ ■ ■ < y q t, 1 < i < q. Then 
(f(x, y#(i, 1)), • • • , f(x, y#(i, t))) (if defined) is the lexicographically least 
z G fld(A)* such that \z\ < min(x) and Ci(x,z) holds in f/r if it exists; 
\x\*t otherwise; 

(iii) / is regressively regular over some E of cardinality p. 

Proof. Let r, B, C±, . . . ,C r be given. We use Lemma 5.3 which asserts 
that any appropriate definition by recursion on the sup norm can be made on 
some finite closed A such that the function is regressively regular over some 
set of cardinality p. 

Accordingly, we can fix finite A C N s+gt and define /: A — > fld(yl) by 
recursion on the sup norm as follows. Let (x,v) G A, where x G N s and 
v G Ni f . 

Case 1. (x,v) = (V, \x'\*s + qt — r). Define f(x,v) = min{j G &d(A):j = 
\x'\ or B(x,j) holds in f/r}. 

Case 2. v = y#(i, 1) for some 1 < i < q and strictly increasing y G N qt , 
where \x\ < y±. If there exists z G fld(yl)* such that \z\ < min(x) and Ci(x,z) 
holds in f/r, then define f(x,v) to be the least z\ among such z's. Otherwise, 
define f(x, v) = \x\. 

Case 3. v = y#(i,j) for some 1 < % < q and 1 < j < t, and strictly 
increasing y G N q , where \x\ < y±. If there exists z G fld(yl)* such that 
\z\ < min(x) and Ci(x,z) holds in f/r and z\ = f(x,y#(i,l))$z ...Szzj-i = 
f{x,y#(i,j — 1)), then define f(x,v) to be the least Zj among such z's. Oth- 
erwise, define f(x,v) = \x\. 

Case 4. Otherwise, define f(x,v) = \x\. 

The quantifications over fld(A)* are represented by t quantifications over 
fld(A), which are in turn represented by a quantification over diagonal elements 
of A (i.e., elements of A all of whose coordinates are identical). If A is closed, 
then these representations are valid. 

By Lemma 5.3, fix finite closed A C N s+qt and /: A -► M(A) defined 
as above, where / is regressively regular over E G S P (N). Then /, E are as 
required. □ 
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Lemma 5.6. Letp,q,r,t > 0, s > r, B G BEF(r + l,r), and Ci, . . . ,C q G 
BEF(s + i,r). Then there exists finite closed A C Ar s +^ /: ,4 ^ fld(A), and 
EON, \E\ = p, such that the following hold: 

(i) For all (x, |x|*s + (jtf — r) £ A, /(x, |x|*s + (7t — r) = min{j G fld( J 4): j = |x 
or B(x,j) holds in f/r}; 

(ii) Suppose that x G E s , u G fld(A)*, \u\ < min(x), 1 < i < q, and Ci(x,u) 
holds for f/r. Then there exists w G fld(j4)* such that for all y G E s of 
the same order type as x, Ci{y,w) holds in f/r; 

(iii) / is regressively regular over E. 

Proof. Let p, q, r, s, t, B, C\, . . . , C q be given. Let A C N s+qt be finite 
closed, and /: A — ► fld(A) obeys (i)-(iii) of Lemma 5.5, with = p + qt. Let 
£" = {E±, . . . ,E p }. We now show that /, E' is as required. 

Suppose that x G E' s , it G fld(A)*, |n[ < min(x), and Ci(x,u) holds in 
//r. Let |x| < y± < ■ ■ ■ < y q t, where y\, . . . ,y q t G E. Then \w\ < min(x) and 
Ci(x,w) holds for f/r, where 

w = (f(x, y#(i, 1)), f(x, y#(i, 2)),..., f(x, y#(i, t))) . 

Now by the regressive regularity of / over E, this w depends only on the order 
type of x, and not on yi, . . . , y qt . This establishes (ii) as required. □ 

Lemma 5.7. Let p, q,r,t > 0, s > r, B G BEF(r + l,r), and C\, . . . ,C q G 
BEF(s + 1, r). Then there exist finite closed ACF and E G S P {N) such that 
the following hold: 

(i) Suppose that x G E s , u G fld( J 4) t , \u\ < min(x), and Ci(x,u) holds in 
Df(B;A). Then there exists w G fld(A)* such that for all y G E s of the 
same order type as x, Ci{y,w) holds in Df(B;A); 

(ii) Df(B; A) is regressively regular over E. 

Proof. Let p, q, r, s, t, B, C\, . . . ,C q be as given. Let A, f, E be as 
given by Lemma 5.6. By clause (i) of Lemma 5.6, we see that for all x G A/r, 
f /r(x) = min{j G Hd(A): j = \x\ or B(x,j) holds in f/r}. By Lemma 5.4, 
M(A) = Qd(A/r). Hence f/r = Df(B;A). This also establishes (i) here. And 
(ii) follows by another application of Lemma 5.4. □ 

We can reformulate Lemma 5.7 in terms of a strengthening of regressive 
regularity. 

We say that / is (t, r)-regular over E if and only if 

(i) t,r >0; 

(ii) f:A—> M{A), where A C iV r is finite and closed; 

(iii) E* C A; 



FINITE FUNCTIONS AND THE NECESSARY USE OF LARGE CARDINALS 843 



(iv) Let C G BEF(2i,*,r), x£ E l ,ue fld(A)*, |u| < min(x), and C(x,u) hold 
in /. Then there exists w G fld(A)* such that for all y G E t of the same 
order type as x, we have that C(y,w) holds in /. 

Lemma 5.8. Let r,p > 0, * > r, B G BEF(r+l,r). Then some Df(B; A) 
is (t,r) -regular over some E of cardinality p. 

Proof. Let r, t, p, B be given. We will apply Lemma 5.7 for suitably 
chosen parameters. Let Ci,...,C q enumerate all elements of BEF(2t, t,r). 
The result follows by Lemma 5.7 since s = t. □ 

Lemma 5.9. Let t > s > and E C iV. Every (t,r) -regular function 
over E is (s,r)-regular over E. 

Proof. Let i, s be as given, and f:A—> fld(A) be (i, r)-regular. Let 
C G BEF(2s,s,r), x e E s ,u e M(A) S , \u\ < \x\, and C(x,u) hold in /. Let 
C G BEF(2i, t, r) be defined by C"(z, w) if and only if C(z\, . . . , z s , wi, . . . , w s ). 
Then C'(x, \x\*t — s,u, \u\*t-s) holds in /. Let w G fld(A)* be such that for all 
y G E l of the same order type as (x, |x|*i — s), we have C'(y,w). Then for all 
y' G -E 15 of the same order type as x, we have that C'(y', \y\*t — s,w) holds in 
/. Hence for all y' G E s of the same order type as x, we have C(y', w\, . . . , w s ) 
holds in /. □ 

We now prove an important consequence of (2r, r)-regularity. Let x, y G 
N k and j G N. We say that x, y are j-related if and only if 

(i) x, y have the same order type; 

(ii) for all 1 < i < k, if x« < j, then y, L = x«; 
(hi) for all 1 < i < k, if x« > j, then j/j > |x|. 

Lemma 5.10. Let r > 1 and p > 4r and f be (2r, r) -regular over E, 
where \E\ = p. Let x,y G E r be f (x) -related. Then /(x) = f(y). 

Proof. Let r,p,f,x,y be as given and let / : A — > fid (A). Write x = 
(Ei 1 , . . . , Ei r ) and y = (Ej 1 ,... ,Ej r ), where x,y are /(x)-related. Assume 
that f(x) ^ /(y)- We can push the i's and j's down to a's and 6's such 
that £;( ai ,...,E ar ,E bl ,...,E br ) has the same order type as (E ai , . . . , £ , flr , 
, . . . , Eh r ), and {ai, ... , a r , b±, . . . ,b r ) is an initial segment of the positive 
natural numbers. Thus the largest of the a's and 6's is 2r. 

Consider the true statements that f{Ei x , . . . , E; lr ) ^ f(Ej 1 , . . . , Ej r ) and 
E h ,... ,E ir ,E jl ,... ,E jr are f(E il , . . . , £ , ir )-related. From (2r, r) -regularity, 
we can derive an appropriate simple indiscernibility, thereby obtaining that 
f(E ai ,...,E ar ) + F(E hl ,...,E br ), and (E ai , . . . , E ar ) , (E bl , . . . , E br ) are 
f(E ai , . . . ,E ar )-related. See Lemma 5.11. 
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Next, note that the part of E ai ,...,E ar that lies strictly above 
f(E ai , . . . , E ar ) corresponds to the part of E^ , . . . , E^ r that lies strictly above 
f{E\,\ j ■ ■ ■ > Eb r ). That is, the two parts lie in the same positions among the a's 
and b's. And the remaining parts are identical, i.e., are the same elements of 
E in the same positions. This is clear again by simple indiscernibility. 

Thus in order to get the required contradiction, it suffices to show that 
we can 

(i) move the part of E ai , . . . , E ar that lies strictly above f(E ai , . . . , E ar ) - 
henceforth called the upper part — all the way to the top of E (preserving 
order type) without changing the value of /; and 

(ii) move the part of E^, . . . , Ef, r that lies strictly above /(E^, . . . , Eb r ) all 
the way to the top of E (preserving order type) without changing the 
value of /. 

As the cases are symmetric, we may work only with E ai , . . . , E ar . 

Since p > 4r, we can move the upper part of E ai , . . . E ar so that the 
new £"s lie among E2 r +i , ■ ■ ■ , E% r . We write this as E C1 , . . . , E Cr . Also we 
write E dl , . . . , E dr for the second move where the new part is at the top of E, 
i.e., forms a tail in E. Hence the new part for the second move lies among 
Esr+li ■ ■ ■ i E p . 

We need to verify that f(E ai , . . . ,E ar ) = f(E dl , . . . ,E dr ). Assume this is 
false. Then by simple indiscernibility, we have 

f(E ai ,. . . , E ar ) / f(E Cl ,. .. ,E Cr ) ^ f(E dl ,. . . ,E dr ) . 

We can rewrite these three distinct values in the form 

f'(E xl , E Xq , E yi , . . . , E Vs ) / f'(E Xl , . . . , E Xq , E Zl , . . . , E z J 

7^ / (E Xl , . . . , E Xq , E Wl , . . . , E Ws ) , 

where E Xl , . . . E Xq is the common lower part, and the y's, z's, and w's are the 
upper parts. Here 

xi < ■ ■ ■ < x q < y 1 < ■ ■ ■ < y s < zi < ■ ■ ■ z s < w\ < ■ ■ ■ < w s , 

and /' results from / by permuting arguments. Note that these values are 
< E yi . 

Observe that there exist u\, . . . , u q , v < E yi such that 

f'(ui, . . .,u q ,E yi ,.. .,E ys ) = v / f'(ui, . . .,u q ,E Zl ,.. . , E z J . 
Hence by (2r, r) -regularity, there exist u±, . . . , u q , v < E\ such that 

f'(ui, . . .,u q ,E yi ,.. .,E ys ) / f'(ui, . . .,u q ,E zl ,.. .,E Zs ) , 
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and 

/'(ui, ...,u q ,E Zl ,...,E Zs )=v^ /'(«!, ...,u q ,E Wl ,...,E Wa ) . 

But this is a contradiction. □ 

Here is an important weak consequence of (t, r)-regularity. 

Lemma 5.11. Let t,r > 0, C G BEF(£, t,r), and f be (t,r)-regular 
over E. Let x,y G E l be of the same order type, where min(x), min(y) > 
min(fld(/)). Then C(x) holds if and only if C(y) holds in f. 

Proof. Let t, r, C, f, x, y be as given. Define C G BEF(2t, t,r) by 
C'(x, y) if and only if C(x) holds. Now let C{x) hold in /. Then C'(x, z) holds 
in /, where z = mm(&d(A))*t. Hence C'(y,z) holds in /, and therefore also 
C(y). □ 

We now introduce another concept of indiscernibility. 

We say that E is a (t, r) — SOI (set of indiscernibles) for / if and only if 

(i) t,r >0; 

(ii) f:A—> fld(A), where A C N r is finite and closed; 

(iii) E r C A; 

(iv) Let C G BEF(3£, i,r), G E 1 *, u> G f[E r ] 1 , x, y of the same order 
type, and \z,w\ <mm(x,y). Then B(x, z, w) if and only if B(y, z, w). 

Note that in the inequality in (iv), we are using a comma for concatenation. 
We leave it to the reader to check that if E is a (i, r)-SOI for / and t > s, 
then E is an (s, r)-SOI for /. 

Lemma 5.12. Let r, t > and p > 3r and f be (2t(r + 2),r)-regular over 
E, where \E\ = p + r. T/ien {i?2) ■ ■ ■ j E p } is a (t, r)-SOI for f . 

Proof. Let p, t, r, /, E be as given, and let f:A — > fld(v4). Without 
loss of generality, we can assume that r,t,p > 1. Let E' = {E2, ■ ■ ■ ,E p }. Let 
C G BEF(3i, t,r), x,y,z G E'* t , and x, y have the same order type, and \z\ < 
min(x, y). Also assume u±, . . . ,ut G E' r , where \ f(u±), . . . , f{ut)\ < min(x, y). 
We need to prove that C(x, z, f(ui), . . . , f{ut)) if and only if 

C(y,z,f(ui),...,f(u t )) 

holds in /. 

Start with the assertion C(x, z, f(u±), . . . , f(ut)) holds, which is treated 
as a statement about the tuples x, z from E', with the t parameters shown 
from M(A). 

Now by Lemma 5.9, / is (2r, r)-regular over E, and so by Lemma 5.10, 
we can write each f(ui) as f(u*) = f(u{), where u* G E r is of the same 
order type as Ui, where ui and u* are /(uj)-related, and every coordinate of 
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u* > f(ui) lies in {E p+ i, . . . , E p+r }. We thus have the equivalent assertion 
C(x,z, /«),.../«)). 

We now view C(x, z, f(ul), . . . , f(u*)) as C'(x, z, . . . , u^), where 
C G BEF(t(r + 2), 2t, r). Note that (x, z,u\, . . . ,u* t ) and (y, z, u*, . . . , u* t ) 
are of the same order type. Hence by (t(r + 2), r) -regularity and Lemma 5.11, 
C'(x ,z,u*,..., Uf) holds if and only if C'(y, z, u\, . . . , u^) holds in /. Therefore, 
C(x, z, /(«;), . . . , f(u* t )) if and only if C(y, z, /(«;), . . . , / «)), as required. □ 

Lemma 5.13. Let r,t,p > and B G BEF(r + l,r). Then there exists 
finite closed A C N r such that Df(B;A) has a (t, r)-SOI of cardinality p. 
Furthermore we can require that max(fld(^4)) = max of the SOI. 

Proof. Let r, t, p, B be as given. We can assume without loss of generality 
that p > 3r. By Lemma 5.8, let Df(B;A) be (2i(r + 2), r)-regular over E of 
cardinality p + r. By Lemma 5.12, {E 2 , . . . , E p+ {\ is a (t, r)-SOI for Df(B;A) 
as required. To obtain the further requirement, simply cut down A to the 
elements of norm at most the max of the SOI. □ 

5.2. Existence of finite towers of finite sets with strong atomic indis- 
cernibles, weak staggered comprehension, and a weak least element principle. 
We now start a rather technical development which culminates in Lemma 5.33. 
We need to build appropriate finite towers of finite sets so that we can apply 
compactness in order to obtain workable linearly ordered structures. 

Let k,r,t > 0. We say that h: N l — > (N U N k ) r is basic if and only if there 
is a quantifier-free formula D (with only < and = on N) which defines h in the 
sense that h(x) = y if and only if D(x,y). No parameters are allowed. This 
involves mixed sorts and tuples of tuples, which are handled in the obvious 
way. We say that x £ iV* is constant if all of its terms are equal. 

Note that if h: N* -► (Nl)N k ) r is basic and E C N, then h: E ^ (EUE k ) r . 

Let E C TV and n > 0. We define E[n] ={E 1 ,..., E n }. For x G (Nl>N k ) r , 
\x\ = max(|xi|, . . . , \x\ r ). 

Lemma 5.14. Let r, p > 0. Then there exists t > 0, < m < • • • < n p 
< t, and basic h: N l — > (N U N t+r ) r such that the following hold: 

(i) For all 1 < i < p and E C N, h maps E[ni + i — r]* onto (E[ni + r]U E[ni + 
r y+ry. 

(ii) For allj G N, h(ft) = fr; 

(iii) If x G N l is not constant, then \h(x)\ < \x\. 

Proof. Let r, p > 0. Set n\ = 8r, and for all 1 < i < p, n,i + \ = nf r . Set 
t = n p+1 . Then for all 1 < i < p, (m + r + (n» + r)* +r ) r < (n i+ i - r)^ - ^ 1 ). 
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Note that \([l,m+r] U [1, m +r] t+r ) r \ = (m +r + (m +r) t+r ) r . Further- 
more, let [1, rii + i — rf be the set of all elements of [1, n^+i — rf whose set of co- 
ordinates is exactly [l,nj+i— r]. Note that (nj+i — r)('~ n » +1 ) < |[1, npi + \ — r]* \. 

By the above inequality, for each 1 < i < p, there exists a surjective map 
hf [1, n i+1 - rf ' ([1, n, + r] U [1, + rf + r ) r . 

We now define h. Let xGJV*. 

Case 1. For some i > 0, the number of coordinates of x is exactly rij + i — r. 
Let x' be the unique element of [l,nj+i — r]* which is order isomorphic to x. 
Then define h(x) to be the unique y such that (x, y) is order isomorphic to 
{x'Mx')). 

Case 2. Otherwise. Define h(x) = x\ *r. 

Clearly h is basic. Now let E C TV and y G (E[m + r] U ^[rii + r]' +r ) r , 
where 1 < i < p. Then (i) follows by transference of E order isomorphically 
onto an initial segment of N. Also (ii) and (hi) follow from Case 2. □ 

For x G N t+r , we define #x to be the greatest i such that x\,...,xt < 
xt+i < • • • < x t +i = ■ ■ ■ = Xt+r- If this does not exist, then #x is undefined. 
Note that if #x exists then 1 < j^x < r. If #x = 1, then the last r coordinates 
of x are equal, and if j^x = r, then the last r coordinates of x are strictly 
increasing. Below, we will be interested almost exclusively in only those x G 
N t+T for which #x exists. 

If 1 < i < r, then define x#(i) = (x±, . . . , xt+i, ■ ■ ■ , xt+i). 

Let / G FPF(iV* +r ). For x G N define f(x) = x. For x G (iV U N t+r ) r 
define /(x) = (/(xi), . . . , /(x r )). 

Let / G FPF(iV t+r ) and /i: AT* -» (iV U iV*+ r ) r . We now define G 
FPF(iV*+ r ,Af r ) as follows. Let x G iV t+r . 

Case 1. #x and f(x) are defined. Define /*[/t](x) = f(h(xi, . . . , xj)). 

Case 2. If otherwise, then /*[/t](x) is undefined. 

Let P, Q be expressions. It is useful to use the notation P — Q for P = Q 
or (P and Q are undefined). Of course, P = Q means that P and Q are defined 
and equal. 

Lemma 5.15. Let t,r > and /i: AT* — > (TV U N t+r ) r be basic. Then there 
exists B G BEF(i + 2r,r + \,t + r) such that for all f G FPF(iV*+ r ), x G N t+r , 
and y G N r , f*[h](x) = y if and only if B(x,y) is true in f. 

Proof. The proof is by inspection of the definition of f*[h]. □ 



For / G FPF(iV fe ) and S C N, we write f[S] for f[S k }. 
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Lemma 5.16. Let r,p > 0. Then there exists t > 0, < n\ < ■ ■ ■ < 
n p < t, and basic h:N l — > (N U N t+r ) r , such that the following hold. Let 
f G FPF(iV*+ r ), E t+r C dom(/), \E\ > n p , 1 < i < p, and x,y G iV*+ r . 

(i) M(f*[h][E[n l + r]]Y C (£[n; + r] U /[£[n, + r]]) r C /* [/i][E[n i+ i]]; 

(ii) If #x,#y, f(x), f(y) exist andx, y have the same first t coordinates, then 
f*[h](x) =' f*[h](y); 

(iii) If f*[h](x) exists, then f*[h](x) is an r -tuple consisting of certain elements 
of {xi, . . . , xt} together with the value of f at certain y C (xi, . . . , xt). 

Proof. Let r,p > 0. Let t,n\, . . . , n p , h be according to Lemma 5.14. Let 
/, E, i be as given. 

For (i), first observe that Rd(f*[h][E[ni + r]]) C E[rii + r] U f[E[ni + r]] 
by inspection. Now let xi, . . . , x r G E[ni + r] U /[E'fnj + r]]. Then there exists 
y G E[ni + i — r]* such that f{h(y)) = (x\, . . . ,x r ). Let z G E[ni + i] t+r extend 
y by the elements of E in positions rij+i — r + 1, . . . , nj+i. Then #z and f(z) 
are defined. So f*[h](z) = f(h(y)) = {x\, . . . ,x r ), as required. 

Claim (ii) is by inspection of the definitions. For (iii), suppose f*[h](x) 
exists. Then f*[h](x) = f(h(x)). Also #x exists, and so x is not constant. 
Hence h(x) is a coordinate of x or h(x) C x = (x\, . . . , Xt). □ 

We now fix r > 2 and p > 9 until the proof of Lemma 5.33 is complete 
and we fix the corresponding t, rt\, . . . , n p , h given by Lemma 5.16. We will 
abbreviate f*[h] by /*. 

We now present the crucial definition by induction on the sup norm . The 
equivalent definition given in Lemma 5.17 is clearer, but is not directly an 
induction on the sup norm. For this purpose, we fix an order-invariant R C 
N r x N r = N 2r , such that for all x,y G N r , R(x,y) \x\ > \y\. 

Let A be a finite subset of N t+r . We define f:A^> fld(yl) as follows. Let 
x G A. 

Case 1. There exists y such that 

W \y\ < M; 

(ii) /(y) = M<|/*(x)|; 

(iii) R(r{x),f*(y)); 

(iv) For all 1 < j < #x, f*{y) 3 = f(x#(j)). 
Define f(x) = min{f*(y)# x : y is as above}. 

Case 2. Otherwise. Define f(x) = \x\. 

We now apply Lemmas 5.13 and 5.15. Note that the determination of 
whether Case 1 applies to f(x) involves only applications of / to tuples of 
lower sup norm than \x\. This follows from Lemma 5.16 (iii). 

We summarize the data that will be fixed until the proof of Lemma 5.33 
is complete: 
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(i) t,r,p,ni, . . . , n p , h, R are previously fixed; 

(ii) f:A — > fld(A) obeying the preceding inductive definition, where A is a 
finite closed subset of N t+r ; 

(hi) E C AT, |£| = n p ; 

(iv) £ is a (t + r, t + r)-SOI for /; 

(v) max(nd(^4)) = max(£). 

Clause (iv) will only be used in the proofs of Lemmas 5.26 and 5.31. 

Lemma 5.17. Let x G A. Then f(x) < \x\. Also f*(x) is defined if 
and only if j^x is defined. And if ffx is defined, then f*(x) < \x\. Also 
E C f[E\. Furthermore, f is the unique function from A into fld(A) such that 
the following hold for all x G A: 
Case V ' . There exists y such that 

(i) f(y) = \y\<\F(x)\; 

(ii) R(f*(x),r(y)). 

Let z = lex min{/*(y): y is as above}. Then f(x) = z# x . 
Case 2'. Otherwise. Define f(x) = \x\. 

Proof. The first claim is by induction on by Lemma 5.16 (hi). The 
second claim follows from Lemma 5.16 (hi) and the fact that A is closed. The 
third claim follows from the first two claims and Lemma 5.16(iii). For the 
fourth claim, note that since E is a (t + r, t + r)— SOI for /, E t+r C A. Hence 
for all j G E, j*t + r G A and #(j*t + r) is undefined. Hence f*(j*t + r) is 
undefined, and therefore f(j*t + r) = j G f[E]. 

For the final claim, let / be as given. Assume Case 1 applies to fix). Then 
Case 1 applies to /(x#(l)), according to Lemma 5.16 (ii). And f{xjf(l)) is 
the least possible first coordinate of the associated f*(y). Also Case 1 applies 
to f(x#(2)), using the /*(y)'s whose first coordinate has been minimized, and 
/(x#(2)) is the least possible second coordinate of these f*(y)'s. We continue 
in this way till we get to f(x). It is clear that we have merely made the hrst 
#(x) steps in the standard lexicographically least element construction on the 
set of y such that Case 1' applies to /(x#(l)) - which is of course the same 
as the set of y such that Case 1' applies to /(x#(2)) and higher, up through 
f(x). This matches Cases 1' and 2' in the lemma, when we note that clause 
(i) in Case 1 follows from clause (i) in Case 1'. □ 

From now on we will refer only to clauses 1' and 2'. 
We define 

f{x) = lex min{f*(y):f(y) = \y\ < \f*(x)\ and R(f*(x)J*(y))} 
if this is nonempty; it is undefined otherwise. 
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Lemma 5.18. For all x G A, f(x) is defined if and only if \f(x)\ < \x\. 
For allx G A, if f{x) is defined, then \f{x)\ < \ f*(x)\. Also if f*(x) = f*(y), 
then f(x) =' r(y). 

Proof. This is by Lemma 5.17 and inspection. □ 

Lemma 5.19. If f(x) is defined and 1 < i < #x, then f(x)i = f(x#(i)). 
If f'(x) is defined, then f(x) = f(x)# x . 

Proof. Assume f"{x) is denned and 1 < i < j^x. Then Case 1' applies to 
f(x), and the z in Case 1' is f(x). Also Case 1' applies to f{x#(i)), and the 
z in Case 1' is again f{x). Hence f{x#(i)) = Zi because = i. 

The second claim follows by the identity x#(#x) = x. □ 

Lemma 5.20. For all x G A, f(x) = f(x)# x if f(x) is defined; \x\ 
otherwise. If f"(x) is defined and #x = r, then 

/» = (/(x#(l)),...,/(ar#(r))). 

If x e E t+r and #x is defined, then f*(x) G f[E] r . If x G E t+r , f(x) is 
defined, and jfx = r, then f"(x) G f[E] r . 

Proof. Let x G A. If Case 1' applies to f(x), then f"(x) is defined, and 
so by Lemma 5.19, f(x)# x = f{x). If Case 1' does not apply to f{x), then 
f(x) = \x\. This establishes the first claim. The second claim is a special case 
of Lemma 5.19. For the third claim, let x be as given. Since E t+r C dom(/), 
we see that f*(x) is defined. Also by Lemma 5.16, f*(x) consists of elements 
of E and f[E]. By Lemma 5.17, E C f[E]. The fourth claim follows from the 
second claim. □ 

Lemma 5.21. If f*(x) is defined, then < x t +i- If f"(x) is defined, 

then \r(x)\ < \f*(x)\. 

Proof. To establish the first claim, suppose f*{x) is defined. Then by 
Lemma 5.16, f*(x) is an r-tuple consisting of elements of {x\, . . . ,x t } and 
values of / at certain y C [x\, . . . ,xt). Also #x is defined. Hence < 
xt+i- By Lemma 5.17, < max(si, . . . , xt) < xt+i- 

For the second claim, suppose f"{x) is defined. Then R(f*(x),f"(x)) by 
the definition of f(x). By the hypothesis on R, we have \f{x) < \ f*(x)\. □ 

Lemma 5.22. The following are equivalent for x G A: 

(i) f*(x) is defined; 

(ii) Case 1' applies to f{x); 

(iii) f{x) < \x\; 

(iv) f(x)<\f*(x)\. 
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Proof, (i) and (ii) are equivalent by the definition of f. 

Assume (ii). By Lemma 5.21, the f*(y) occurring in the lex min in Case 
1' applied to f(x) must have |/*(y)| < |/*(x)| < xt+i- Hence (iii) and (iv) 
hold. 

Now obviously (iii) implies (ii). Hence (iii) implies (iv). 
Finally, by Lemma 5.17, |/*(x)| < \x\ if defined, and hence (iv) implies 
(iii). □ 

For 1 < i < p, define V(i) = f*[E[rii]]. By Lemma 5.16 we have 
(E[rii + r] U fld(V(i))) r C V(i + 1), where 1 < i < p - 1. We also define 
the monadic predicate P on N r by 

P(x) if and only if there exists y such that 

f*(y) = x and f(y) < \y\. 

Lemma 5.23. If P(f*(x)), then f{x) < \x\. 

Proof. Let P(f*(x)). Let f*(y) = f*(x) and f(y) < \y\. By Lemma 5.18, 
f(y) — f( x )- By Lemma 5.22, f(y) is defined. Hence f(x) is defined, and 
so by Lemma 5.22, f(x) < \x\. □ 

Lemma 5.24. If f(x) < \x\, then -^P(f(x)). 

Proof. Let f(x) < \x\. By Lemma 5.22, f(x) is defined. By the definition 
of let f(y) = \y\ and f*(y) = f"(x). Suppose P{f"{x)). Then by Lemma 
5.23, f(y) < \y\, which is a contradiction. □ 

Lemma 5.25. Let 1 < i < p — 1, x & V(i), and P(x). Then there exists 
y <G V(i + 1) such that R(x,y) and ->P(y). 

Proof. Let i, x be as given. Let f*(z) = x, z G E[ni] t+r . By Lemma 
5.23, f(z) < \z\. By Lemma 5.24, ->P(f"(z)). Now by the definition of we 
have R(x,f(z)). It remains to show that f(z) G V(i + 1). By Lemma 5.20, 
r(z) € f[E[m]] r . By Lemma 5.16, f[E[n t ]] r C f*[E[n i+1 }], as required. □ 

Lemma 5.26. Let x e V(p — 1), 1 < i < n p , and \x\ < Ei. Then there 
exists \y\ < Ei such that f*(y) = x. 

Proof. Let x be as given. Let y' G E[n p -i] t+r , f*(y') = x. The true 
sentence 

there exists y <G A such that \y\ < max(E') and f*(y) = x 

can be viewed as a formula in BEF(r + l,r + 2, t + r) about x and ma,x(E). 
Now x G f[E] r . Since E is a (t + r, t + r)-SOI for /, we can replace max(£ l ) 
by Ei. □ 
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Lemma 5.27. Let x G rng(/*) and \x\ G E. Suppose there exists y G 
V(p — 1) such that R(x,y) and ->P(y). Then P(x). 

Proof. Let x, y be as given, and let f*(v) = x. Since R(x,y), we have 
\y\ < \x\. Hence by Lemma 5.26, let f*(w) = y and \w\ < \x\. Since -*P(y), 
we have f(w) = \w\. Combining this with R(x,y), we see that Case 1' applies 
to f(v), and so f(v) < \v\. Therefore, P(x). □ 

Lemma 5.28. Let 1 < i < p - 2, x G V(i), and \x\ G E. Then P(x) if 
and only if there exists y G V[i + 1) such that R(x,y) and ->P(y). 

Proof. The proof is from Lemmas 5.25 and 5.27. □ 

Lemma 5.29. Let 1 < i < p - 2, x G V(i), P(x), and \x\ G E. Then the 
lexicographically least y G V(p — 1), such that R(x,y) and -iP(y), exists, and 
lies in V(i + 1). 

Proof. Let i, x be as given. By Lemma 5.25, this y exists. Let f*(w) = x, 
w G E[ni\ t+r , as in the proof of Lemma 5.25. There we showed that R(x, f~(w)) 
and f(w) G V(i + 1). It remains to show that f(w) is the least y G V(p — 1) 
such that R(x, y) and ~^P(y). By definition, f(w) is the lexicographically least 
f*(u) such that R(x, f*(u)) and f(u) = \u\ < \x\. 

Let y G V{p — 1), R(x,y), and —>P(y). By Lemma 5.26, since |x| G E, let 
f*(u) = y, \u\ < \x\. Since -iP(y), we have /(«) = \u\. Hence by the definition 
of we have f(w) <\ cx y, as required. □ 

Lemma 5.30. There exists B G BEF(r + 1, r + 2, t + r) such that for all 
x G V{p — 1), B(x,meix(E)) if and only if P{x). 

Proof. Let x G V(p — 1). We claim that P{x) if and only if there exists 
y G dom(/) such that f*{y) = x and f(y) < \y\ < max(P). To see this, 
let y' G dom(/), f*(y') = x, and f{y') < \y'\. Now \x\ < max(£). Now 
by Lemma 5.26, let \y\ < max(E), f*(y) = f*(y') = x. By Lemma 5.18, 
f (y) = f ill')- Hence by Lemma 5.22, f(y') < \y'\ if and only if f{y) < \y\. 
Therefore f(y) < \y\ < max(E') as required. Using Lemma 5.15, we see that 
this statement is of the form B(x, max(£)), where B G BEF(r+l, r+2, t+r). □ 

We now give the form of indiscernibility used later. 

Lemma 5.31. Let 1 < i < r, x, y G E[n p - 2 ]\ z G M(V(p - 2)) r ~\ where 
x, y are of the same order type. Let it be a coordinate permutation of all r- 
tuples (i.e., there are exactly r! such ir). If \z\ < mm(x,y), then P(ir(x,z)) if 
and only if P(i:(y, z)). 

Proof. By Lemma 5.30, P(ir(x,y)) is equivalent to a formula in 
BEF(r + 1, r + 3, t + r) about x, y, and max(£), for (x, y) G V(p — 1). Now let 
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x, y, z, i be as given. Clearly (x, z), (y, z) G V(p — 1). Thus we apply this repre- 
sentation together with the fact that E is a (t + r, t + r)-SOl and y, z G f[E] r ~ l , 
to obtain the result. □ 



We now combine Lemmas 5.28, 5.29, and 5.31 into a single concise state- 
ment. Recall that we have previously fixed r > 2 and p > 9. 

Lemma 5.32. For all 1 < i < p, let A, t = M(V(i)). 

(i) For all I < i < p, E[m] C A i+ i; 

(ii) For all 1 < i < p — 4 and x G {Ai) r with \x\ G E, we have P(x) if and 
only if there exists y G (Ai + 2) r such that R{x,y) and ->P(y); 

(hi) For all 1 < i < p — 4 and x G (^4«) r with \x\ G F, P(x) if and only if the 
lexicographically least y G (A p _2) r such that R(x, y) and -<P(y) exists and 
lies in (A i+2 ) r ; 

(iv) For all 1 < i < r, and x,y G E[n p -2} 1 of the same order type, and z G 
(Apsy^ 1 , and coordinate permutations ir of r -tuples, if \z\ < min(x,y) and 
\x,y\ < max(E), then P(w(x,z)) if and only if P(ir(y, z)). 

Proof. Recall that each A { = fld(V(i)) = &d(f*[E[m]]). By Lemma 5.16, 
for all 1 < i < p, {E[ni + r] U M(V(i)) r C V(t + 1). Clearly (i) holds. 

For (ii), let i, x be as given. Then x G V(i + 1). By Lemma 5.28, if 
P{x), then there exists y G (Ai + 2) r such that R{x,y) and ~^P(y). On the 
other hand, if there exists y G (Aj + 2) r such that R(x, y) and ^P{y), then there 
exists y G F(i + 3) such that R{x,y) and -<P(y), and hence by Lemma 5.28, 
P(x). 

For (hi), let i, x be as given. Then x G V(« + 1). Suppose P{x). By 
Lemma 5.29, the lexicographically least y G V(p — 1) such that R(x, y) and 
->P(y), lies in V(t + 2). Now V(t + 2) C (^ i+2 ) r C (A p _ 2 ) r C V(p - 1). Hence 
this y is the lexicographically least y G (A p ^ 2 ) r such that R(x,y) and -*P(y), 
and lies in (^4j + 2) r . 

And (iv) follows immediately from Lemma 5.31. □ 

We now streamline Lemma 5.32 as follows. 

Lemma 5.33. Let 2n < p — 4. Then there exist nonempty finite sets 
R\ Q B-2 C • • • C B n C suc/i t/iat i/ie following hold: 

(i) For all 1 < i < n, max(Sj) = F 1 ^ 

(ii) For all 1 < i < n and x G (-Bj) r wrai/i |x| G F, P(x) if and only if there 
exists y G (Bi + i) r such that R(x,y) and ->P(y); 

(hi) For all 1 < i < n and x G (F»i) r wi/i |x| G F, P(x) if and only if the 
lexicographically least y G (B n ) r , such that R(x,y) and ->P(y), exists and 
lies in (F>j + i) r ; 
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(iv) For alll <i <r, andx,y G E[n] 1 of the same order type, and z G (B n ) r ~ l ', 
and coordinate permutations ir of (B n ) r , if\z\ < min(x,y), then P(tt(x, z)) 
if and only if P(n(y, z)). 

Proof. Let 2n < p-A. For all 1 < i < n, set B { = A 2i n [0,^]. Then (i) is 
evident. To verify (ii), let 1 < i < n, x G (E>i) r , and |x| G -E. Hence |x| < 
Now (.Bi) r C (yl2«) r ) an d so (ii) of Lemma 5.32 applies. So P{x) if and only if 
there exists y G (A2i+2) r such that R(x,y) and ->P(y). Since R(x,y) implies 
|x| > |y|, we can replace (^42«+2) r with (i?j + i) r . 

To verify (hi), let 1 < i < n and x G B\ with |x| G -E. Hence |x[ < E{. 
Then we can apply (hi) of Lemma 5.32 to 2i. Thus P(x) if and only if the 
lexicographically least y G ( J 4 p _2) r , such that R(x,y) and ^P(y), exists and 
lies in (A2i+2) r - Again using R(x,y) implies \x\ > \y\, we see that P{x) if and 
only if the lexicographically least y G ( J 4 p _2) r , such that R(x,y) and -iP(y), 
exists and lies in (E>i + i) r . 

Finally, (iv) is immediate from the (iv) of Lemma 5.32. □ 

We make use of the following construction. Let R be an order invariant 
subset of N s . Let (A, <) be a linear ordering. Then R can also be viewed as 
an order invariant subset of A s by taking the set of all elements of A s which 
are of the same order type as an element of R. 

5.3. Existence of infinite linearly ordered predicates with strong atomic 
indiscernibles, comprehension for bounded formulas of limited complexity, and 
a weak least element principle. The next lemma is an application of the com- 
pactness theorem for predicate calculus, and brings us to the major milestone 
of working within an ordinary relational structure instead of finite towers of 
finite sets. 

Lemma 5.34. Let k > 2 and R be an order-invariant subset of N k x 
N k such that for all x,y G N k , if R(x,y) then \x\ > \y\. Then there exists 
(A, <, E, P) obeying the following conditions: 

(i) (A, <) is a countable linear ordering; 

(ii) E = {ei < e2 < . . . } is an unbounded subset of A; 
(hi) PCA k ; 

(iv) For all x G A k with \x\ G E, P(x) if and only if there exists y G A k such 
that R(x,y) and ->P(y); 

(v) For all x G A k with \x\ G E, P{x) if and only if there exists a lexicograph- 
ically least y G A k such that R(x,y) and ->P(y); 

(vi) For all 1 < i < k, and x,y G E 1 of the same order type, and z G A k ~ l , 
and coordinate permutations it of A k , if \z\ < mm(x,y), then P(tt(x,z)) 
if and only if P(ir(y, z)). 
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Proof. By compactness. Fix k > 0. We use the following symbols: 

(a) the binary relation symbol <; 

(b) monadic predicate symbols A\ , A 2 , . . . ; 

(c) the k-ary predicate symbol P; 

(d) the constant symbols ei,e 2 , ■ ■ ■ ■ 

We consider the following set T of axioms: 

(1) < is a linear ordering; 

(2) for all i: Ai(x) => A i+1 (x); 

(3) for all i: max(Ai) = ef, 

(4) for all i < j: e« < ef, 

(5) for all i, t: 

(Ai(xi)& . . . &Ai(x k ) & max(xi, ... ,x k ) = e t ) 
=> (P(x 1: . ..,x k )-& (By!, ...y k ) 
(A+i(yi) & ••• & A i+1 (y k ) & R(x!, . . . , x k ,y!, . . . ,y k ) 
k^P( yi ,...,y k ))); 

(6) For all i, t: 

(Ai(xi) k ... &Ai(x k ) & max(xi, ... ,x k ) = e t ) 
^> (P(xi, . . . , x k ) ^ there exists lexicographically least (yi, . . . , y k ) 
such that (R(x u ...,x k ,y 1} .. . ,y k ) &-iP(yi, . . . ,y k ))) ; 
furthermore, this (y 1 , . . . , y k ) has A i+1 (y!, ...,y k ); 

(7) Let 1 < i < k, and 1 < ji, ■ ■ ■ ,ji,pi, ■ ■ ■ ,Pi, where (ji,...,ji) and 
(pi, . . . ,Pi) have the same order type. Let n be a coordinate permutation of 
/c-tuples. For all z\, . . . , z k _ { < min(eji, . . . , eji, e p i, . . . , e pi ), 

P(n(eji, eji, z\,..., z k -i)) P(n(epi, e pi , z\,..., z k -i)). 

We use Lemma 5.33 to show that every finite subset of T has a (finite) 
model. Fix To to be any finite subset of T which uses at most A±, . . . , A n and 
e\, . . . , e n , n > 1. In Lemma 5.33, set r = k, p = 2n + 7, and use the same 
n. Fix nonempty finite sets B\ C • • • C B n C N according to Lemma 5.33. 
Our model of To will have universe B n , and < will be the standard ordering on 
N restricted to B n . The interpretation of A\, . . . , A n will be just B\, . . . , B n . 
The interpretation of P will be the P of Section 5.2. The interpretation of 
ei,...,e n will be E\, . . . , E n . 

By the compactness theorem, T is satisfiable, and so let 

(X,<,P,e 1 ,e 2 ,...;A 1 ,A 2 ,...) 

be a countably infinite model of T. Let A be the union of the AiS. Note that 
A may be a proper subset of X. Restrict this model down to the submodel 
(A, <,P, e\, e 2 , ■ ■ ■ ; A\, A 2 , . . . ). Using axiom scheme (3), we see that this is 
still a model of T, and also condition (ii) holds. □ 
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We now define Fm(j, n, k) for j > and k > by induction as follows. 
Here Fm abbreviates "Formula." Recall the notation u*m = u,u, . . . ,u, where 
m > 0. 

We let Fm(0, n, k) be the formulas of the following form: 

(i) y < z, where i/, z ST6 among the variables xi, . . . , x n \ 

(ii) -iP(yi,y 2 , • • • ,y n -i,y n *(,k -n + 1)), where each y { is among xi, . . . ,x n . 
Note that we are using P as a /c-any relation symbol. 

In case n > k, (ii) will simply consist of all formulas of the form 
->P(yi, . . . , yk), where each yi is among x\, . . . , x n . 

Let j > 0. We define Fm + (j, n,k) as Fm(j,n, k) together with the nega- 
tions of elements of Fm(j,n,k). Let DFm + (j,n,k) be Fm + (j, n, k) together 
with all disjunctions of distinct elements of Fm + (j, n, k). Let BFm(j, n, k) be 
DFm + (j, n, k) together with all disjunctions of negations of distinct elements 
of DFm + (j,n,k). Note that every propositional combination of elements of 
Fm(j, n, k) is propositionally equivalent to an element of BFm(j, n, k), and vice 
versa. 

Finally, we let Fm(j + 1, n, k) be formulas obtained by putting a block of 
zero or more distinct existential quantifiers in front of elements of BFm(j, n,k). 
Note that BFm(j, n, k) C Fm(j + 1, n, k). These quantifiers are required to be 
among Xi, . . . ,x n . 

Note that each Fm(i, n, k) is finite. Furthermore, for all k, k! > n, 
|Fm(i, n, k)\ = |Fm(i, n, and the same equality holds for Fm + , DFm + , and 
BFm. Let (A, <,P) be given, where < is a linear ordering on the nonempty 
set A, and PQA k ,k>l. 

Let Q € Fm(i,n,k), y € A and s be a partial variable assignment. That 
is, s assigns elements of A to zero, some, or all of the free variables in Q. 

We say that Q holds < y if and only if the formula is true under any 
interpretation of the unassigned free variables by elements of {z G A: z < y}, 
and where all quantifiers range over {z <G A: z <y}. Note that this definition 
makes sense for any formula Q in the language of <, =, P, and we will use 
this remark in Lemma 5.51 below. 

Most often, we apply this definition to the case where there is no partial 
variable assignment - i.e., s is empty. We also apply this definition to the case 
where s is a total variable assignment (i.e., assigns elements of A to every free 
variable). We will make sure that s can always be inferred from context. 

We fix the dimension k > until the proof of Lemma 5.47 is complete. 

For p > 0, let Y(p) be the set of all x € N k whose first p+1 coordinates are 
not all equal, and the first term is \x\. Note that p < q implies Y(p) C Y(q). 

We say that R is a roi if and only if R C N k x N k = N 2k is order invariant 
and for all x,y E N k , R(x,y) \x\ > \y\. (Here roi means regressive order 
invariant.) 
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We say that R is a p-roi if and only if 

(i) R is a roi; 

(ii) for all x,y G N k , if R(x,y), then x G Y(p). 

Let i? be a roi. We say that (A, <,E,P) is i?-good if and only if 
(A, <,E,P) obeys conditions (i)-(vi) in Lemma 5.34, where of course R is 
reinterpreted as the corresponding order invariant subset of A k x A k as dis- 
cussed at the end of Section 5.2. Thus Lemma 5.34 asserts that for all roi R 
there is an i?-good (A, <,E,P). We say that (A, <,E,P) is (R,p)-good if and 
only if it obeys conditions (i)-(vi) in Lemma 5.34, where in (iv) and (v), we 
restrict x to be in Y(p). 

In the next several lemmas we will build p-roi's for steadily increasing p. 
We want to use each roi to help define the next roi. Accordingly, let R be a 
roi. We say that a roi S is a p-extension of R if and only if for all x, y G A k 
with x G Y(p), we have R(x, y) if and only if S(x, y). 

We say that R is 1-empty if and only if for all x, y G A k , if x G Y(l) then 
-^R(x,y). 

Lemma 5.35. Let R be l-empty, (A, <,E, P) be R-good, i > 0, x G A k_1 , 
and \x\ < ej. Then ^P(ei,x). 

Proof. By (iv) in Lemma 5.34, P(ei,x) if and only if there exists y G A k 
such that R(ei,x,y) and -<P(y). Note that if \x\ < e,, then (ej,x) G 1^(1). 
Hence if |x| < ej, then -^P(ei,x). □ 

Lemma 5.36. Let n > 1. There exists a 1-empty n 2 -roi R such that the 
following holds: 

Let Q be of the form x a < Xf,, where 1 < a, b < n. Then there exists 
2 < p < n 2 such that for all i > 1 and 1 < m < k — p — n — 1, 

Q iff Piei+m p, ej_|_ m _i, . . . , ej, X\, . . . x n , ei ) 

holds < ei in all (R,n 2 )-good (A, <, E, P). 

(Note. We write * at the end of arguments for P to indicate zero or 
more copies of ej in order to fill out the k arguments needed for P.) 

Proof. We first define R(x,y) to be false for x G ^(1). Note that the Q's 
in question do not mention P. 

Now assign a unique index 2 < p < n 2 to each Q of the given form. 
(Normally we would need to use n 2 + 1 instead of n 2 , but we only need to 
handle one formula of the form x a < x a .) We can obviously arrange R to 
ensure that for all 2 < p < n 2 and x±, . . . ,x n < e^, 

-P( e i+m Pi &i+m— 1 j • • • > e i> %1 j • • • j %ni e i ) 
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if and only if there exists \y\ < ej such that Q & -iP(ej, y), where Q is assigned 
index p. By Lemma 5.35 and i > 1, we see that the right-hand side of this 
equivalence is equivalent to Q. □ 

Lemma 5.37. Let n > 1. There is a 1- empty |Fm(0, n, &)|-roi i? suc/t 
that the following holds: 

Let Q G Fm(0, n, k). Then there exists 2 < p < |Fm(0, n, fe)| such that for 
all i > 1 and 1 < m < /c — p — n — 1, 

Q iff P(ei+ m p, ei+m—i, . . . , ej, xi, . . . , x n , ej ) 

/io/ds < e-i in all (R,\Fm(0,n,k)\)-good (A,<,E,P). 

Proof. Let R be as in Lemma 5.36, which takes care of the formulas in 
Fm(0, n, k) that do not mention P. We now define R' to be an n 2 -extension 
of R as follows. Assign to each remaining Q in Fm(0, n, k) a unique index p in 
the interval (n 2 , |Fm(0, n, fe)|]. We can arrange for R' to ensure that if i > 0, 
1 < m < k — p — n — 1, and |x| < e^, then 

P(&i+m Ci+m— 1) ■ ■ ■ ) 6j, Xi, . . . , X n , ej ) 

if and only if Q. Now i?' is as required. □ 

Lemma 5.38. Let n > 1. T/iere is a l-empty |Fm + (0, n, fc)|-roi i? suc/i 
that the following holds: 

Let Q G Fm + (0, n, k). Then there exists 2 < p < |Fm + (0, n, k)\ such that 
for all i > 1 and 2 < m < k — p — n — 1, 

Q i/ anrf onJt/ i/ P(e i+m *p, e i+m -i, . . . , e i} Xi, . . . ,x n ,ei*) 

holds < &i in all (R, |Fm + (0, n, k)\)-good (A, <,E,P). 

Proof. Let R be as in Lemma 5.37. We define R' to be an |Fm(0, n, k)\- 
extension of R as follows. We have to take care of Q = -iQ', where Q' G 
Fm(0, n, fc). Let p be used for Q' in Lemma 5.37 and let 

p' G (|Fm(0,n,fc)[, |Fm + (0, n, k)\] 

be used for Q here. We can arrange R' to ensure that for all \x\ < e^, 
P(e i+m -i*p',e i+m ,...,ei,x,ei*) if and only if ->P(e i+m - 1 *p,e i+m -2, ■ ■ ■ , 
ej, x, e« *) if and only if -iQ' if and only if Q. Here x = xi, . . . , x n . □ 

Lemma 5.39. Let n > 1. T/iere is a l-empty |L>Fm + (0, n, fc)|-roi i? stic/i 
t/iat i/ie following holds: 

Let Q G DFm + (0,Ji,fc). T/ien t/iere exists 2 <p < |L>Fm + (0, n, fe)| suc/i 
i/iai /or all i > 1 and 3 < m < k — p — n — 1, 
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Q if and only if P(e i+m *p, e i+m _i, . . . , e*, Xi, . . . , x n , ej *) 
holds < a in all (R,\DFm + (0,n,k)\)-good (A,<,E,P). 

Proof. Let R be as in Lemma 5.38. Define R' to be an |Fm + (0, n, k)\- 
extension of R as foliows. We have to take care of Q = (B\ or . . . or B t ), where 
Bi, . . . , B t G Fm + (0, n, k). Let pi,...,pt be the indices used for ->Bi, . . . , -<B t 
in Lemma 5.38. Let p be used for Q here. We can arrange R' to ensure 
that for all |x| < ei, P(ei+ m *p, ej+ m _i, . . . ,ei,x, e« *) if and only if there exists 
1 < j < t such that -^P(e i+m -i*pj,e i+m -2, ■ ■ ■ ,ei,x,ei*) if and only if Q. 
Here x = x\, . . . , x n . □ 

Lemma 5.40. Let n > 1. T/iere is a 1- empty |BFm(0, n, fc)|-roi i? 
such that the following holds: 

Let Q £ BFm(0, n, fc). T/ien i/iere exists 2 < p < |BFm(0, n, k)\ such that 
for all i > 1 and A < m < k — p — n — 1, 

<2 */ and only if P(e i+m *p, e i+m -i, . . . , e^, Xi, . . . , X n , ej *) 

ZioWs < ei in all (R,\BFm(0,n,k)\)-good (A,<,E,P). 

Proof. This is proved from Lemma 5.39 in the same way that Lemma 5.39 
was proved from Lemma 5.38. □ 

Lemma 5.41. Let n > 1. There is a 1-empty |Fm(l, n, fc)|-roi R such 
that the following holds: 

Let Q G Fm(l, n, k). Then there exists 2 < p < |Fm(l, n, k)\ such that for 
all i > 1 and 5 < m < k — p — n — 1, 

Q if and only if P(e i+m *p, e i+m -i, . . . , a, x±, . . . ,x n , ei *) 

holds < ei in all (R, |Fm(l, n, k)\)-good (A, <, E, P). 

Proof. Let R be as in Lemma 5.40. Define R' to be a |BFm(0, n, k)\- 
extension of R as follows. Let Q be (3x q i, . . . , z q d)(Q'), where 

Q' e BFm(0, n, k) , d>0, 

and 1 < q±, . . . ,qd < n are distinct. Let p' be the index used for —>Q' (put 
in proper form) in Lemma 5.40, and p be the index used for Q here. We can 
arrange R' to ensure that for all \x\ < ej, 

P(&i+rn Pi &i+m— 1 > ■ ■ ■ i &i > %1 > ■ ■ ■ j j e i ) 

if and only if 

-<P(e i+m _i V, ei+m-2, ...,e i ,y 1 ,...,y n ,e i *) 
holds for some y±, . . . ,y n < e« such that for all j / 91, • • • , 9d> 2/j = The 
right-hand side of this equivalence is equivalent to Q. □ 
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Lemma 5.42. Let n > 1 and r > 0. There is a 1-empty |BFm(r, n, fc)|-roi 
R such that the following holds: 

Let Q € BFm(r, n, k). Then there exists 2 < p < |BFm(r, n, k)\ such that 
for all i > 1 and Ar+A<m<k — p — n — 1, 

Q if and only if P(e i+m *p, e i+m _i, . . . , e i: xi, . . . , X n , ej *) 

/jo/ds < e, in a// |BFm(r, n, fc)|)-^oo(i (A, <, E, P). 

Proof. The proof is by induction on r. Argue just as we argued cumula- 
tively to get Lemma 5.41. □ 

5.4. Existence of linearly ordered predicates with limit points, strong in- 
discernibles for bounded formulas of limited arity, and comprehension and the 
least element principle for bounded formulas. 

Lemma 5.43. Let r, n, n' > 1, n' > n, and |BFm(r, n' , k)\+Ar+n'+6 < k. 
Then there exists a 1-empty |BFm(r, n', fc) | -roi R such that the following hold: 

(i) Let Q G BFm(r, n, k). Then there exists 2 < p < |BFm(r, n, k)\ such that 
for all i > 1, 

Q if and only if P(ej +4r+4 *p, e i+4r+ 3, . . . , ej, x\, . . . , x n , e, *) 

holds < ei in all (R, |Fm(r, n, k)\)-good (A, <,E,P); 

(ii) Let Q' £ BFm(r, n', k). Then there exists p' < |BFm(r, n', k)\ such that 
for all i > 1, 

Q' if and only if P(e i+4r+4: *p', e i+4r+3 , . . . , e i: x\, . . . , x n >, ej *) 

holds < ei in all (R, |BFm(r, n', k)\)-good (A,<,E,P). 

Proof. Let R be a |BFm(r, n, fc)|-roi according to Lemma 5.42. Then 
obviously the above holds without considering Q' . We construct the required 
|BFm(r, n', fc)|-roi R' to be a |BFm(r, n, /c)|-extension of R. Now R' is obtained 
by repeating the proof of Lemma 5.42, starting with formulas in 
BFm(0, n' , fc)\BFm(r, n, k), using indices that are greater than |BFm(r, n,k)\. 
All of BFm(r, n', &)\BFm(r, n, k) is handled in this manner. Finally, note 
that every element of BFm(r, n, k) is appropriately equivalent to an element 
of BFm(r, n', fe)\BFm(r, n, fe). □ 

If Lemma 5.43 holds for r, n, n', k, R, then we say that R handles 
[BFm(r, n, k), BFm(r, n' , k)]. 

Lemma 5.44. Let r, n,n' > 0, n' > n, and |BFm(r, n' , k)\+4r+n'+6 < k. 
Then there exists a |BFm(r, n', k)\ + 3-roi R which handles [BFm(r,n, fc), 
BFm(r, n' , k)\ such that for all (R, |BFm(r, n', k)\ + 3)-good (A,<,E,P): 
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(i) (A,<) is a countable linear ordering with a least element in which every 
element has a unique successor; 

(ii) E = {ei < e2 < • • • } is an unbounded set of limit points of (A, <). 

Proof. Let R handle [BFm(r, n, fc), BFm(r, n', fc)]. We can construct a 
|BFm(r, n', k) [-extension R' of R such that for all (R 1 , |BFm(r, n', k) \ + 2)-good 

(A,<,E,py. 

(1) If R'(x, y), then it is not the case that x starts with exactly |BFm(r, n',k)\ 
+ 1 identical coordinates and no more; 

(2) For all n > 1 and \x\ < e n , ^P{e n *|BFm(r, n' , k)\ + l,x); 

(3) For all z < e 3 , P(e 3 *|BFm(r, n,' , fc)| + 2, z*) if and only if there exists a 
fc-tuple (z*|BFm(r,ra',fc)| + l,u*) such that ^P(z*|BFm(r, n', fc)| + l,u*) 
and u < z if and only if there exists a lexicographically least fc-tuple 
(z*|BFm(r,n',fc)| +l,u*) such that ->P(z*\BFm(r,n' ,k)\ + 2,u*) and u < z; 

(4) For all i > and u < ei, P(ej+i * | BFm(r, n', k)\ + 3, ej, u*) if and only 
if there exists u < v < ej such that -iP(ej,v*) if and only if there exists a 
lexicographically least fc-tuple (ei,v*) such that ->P(ei,v*) and u < v < ej. 

Note that (2) follows from (1). 

By (2), -iP(e2 *|BFm(r, n', fc)| + l,ei*). By setting z = ei and u = e\ in 
(3), we see that P(e^ *|BFm(r, n', fc)| + 2, z*). Hence there is a lexicographically 
least fc-tuple (z* |BFm(r, ri, k)\ + 1, u*) such that ^P(z*|BFm(r, n',k)\ + l,u*). 
Hence the u in this fc-tuple must be the least element of A. Now since 
P(e 3 *|BFm(r, n' , fc)| + 2, e2*), by the indiscernibility of P (going back to 
Lemma 5.34 (vi)), we have P(e 3 *|BFm(r, n', k)\ +2,ei *). Hence by (3), there 
exists u < e\. Thus, the least element of A is < ei. 

By 1-emptiness, we see that for all f < ej, -P(ej,t>*). By (4), if u < ej 
and there exists u < v < ej, then there is a least v such that tt < v < ej. Also 
observe that if u < ej and there does not exist u < v < ej, then -P(ej + i * | 
BFm(r, n, fc) | +3, ej,it*). Fix such a u < ej. By the indiscernibility of E, we 
have -iP(ej+2 * | BFm(r, n, fc) | +3, ej+i, u*), which is a contradiction. Hence 
there is no greatest u < ej. So for every u < ei there exists u < v < ei, and in 
fact a least w such that u < v < ei. Now recall that E is unbounded in (A, <) 
by Lemma 5.34. This establishes the lemma. □ 

We let be the least element of A. For any x < ei, i > 0, we let x+ be the 
least element of A that is > x. The result of iterating the + operation starting 
with yields elements < 1 < • • • below e± that form an initial segment of A 
of order type u. 

Henceforth we will view any element of iV as the corresponding element 
of the initial segment of A of order type uj. In general, we will say that x is a 
finite element of A if a: is in the initial segment of A of order type uj. 
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We say that R sharply handles [BFm(r, n, k), BFm(r, n' , k)] if and only if 
r, n, n' , k, R are as in Lemma 5.44. 

It is convenient to let c(r,n) = |BFm(r, n, k)\ + 8r + 2n + 12. Note that 
this expression does not depend on k provided n < k, which we can always 
assume. 

Lemma 5.45. Let r,n > 1 and R sharply handle [BFm(r, n, k), 
BFm(r, c(r, n), k)]. Then there exists q < \BFm(r, c(r,n), k)\ such that the 
following holds: 

Let Q £ BFm(r, n, k) . Then there exists p < c(r, n) such that for all i > 1, 

Q if and only if P(ej +8r +9 *Q, ei+8r+8, ■ ■ ■ ,e i ,x 1 , . . . , x n ,p, e i+4r+5 *) 

holds < a in all (R, |BFm(r, c(r, n))| +3)-good (A,<,E,P). 

Proof. Let r, n, R be as given. Let Q'(xi, . . . , X4 r+n+ s) be the formal ex- 
pansion of the following assertion: 

(1) There exists t < |BFm(r, n, k)\ such that x^ r+n+ Q = t and 

P(xi *t, X 2 , ■ ■ ■ , X 4r+n+5 , X 4r+5 *) . 

The formal expansion is obviously a disjunction (over t) of conjunctions 
of length 2, where the second conjunct of each conjunction is in 

BFm(0, c(r, n),k). 

In the expansion, we require that all bound variables be other than 

X\ , . . . , X4 r -|_ n _|_g 

in order to perform certain predicate calculus substitutions. 

Observe that for t < |BFm(r, n, k)\, the formula X4 r + n +6 > t expands 
into an element of Fm(l, c(r, n), k), when one uses a block of t + 1 existen- 
tial quantifiers. Hence the formula X4 r+n+ 6 < t expands into an element of 
BFm(l, c(r,n),k). Also the formula X4 r+n+ 6 > * expands into an element of 
Fm( 1, c(r, n), fc). Hence the formula X4 r + n +6 = t expands into an element of 
BFm(l, c(r, n), k), up to tautological equivalence. 

From this we see that the expansion of Q' lies in BFm(l, c(r, n), k). From 
now on Q' will indicate this expansion of Q'. Note that this expansion is valid 
in all (R, |BFm(r, c(r, n))| + 3)-good (A, <,E,P) by Lemma 5.44. 

Observe that for all i,j>0 and xi, . . . , X4 r+n+ 6, 

(2) Q'(x±, . . . ,X4 r+n+ 6) holds < ej if and only if Q'{x\, . . . , X4 r+n _|_6) holds 
< e-j. 

By Lemma 5.43 (ii), choose q < |BFm(r, c(r, n), k)\ such that for all i > 1, 

(3) Q'(xi, . . . , x 4r+n+6 ) if and only if 

P{&i+Ar+A *Qi Cj+4r+3> • • • j e ii x li ■ ■ ■ j x c(r,n)i e i *) 

holds < in all (i?, |BFm(r, c(r, n), fc)| + 3)-good (A, <,E,P). 
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Hence by predicate calculus manipulations, for alH > 1, 

(4) Q'(xi, . . . , x 4r+n+6 ) if and only if 

-P(ei+4r+4 *q, e«+4r+3) • • • , ej , Xi , . . . , X4 r+n+ Q, ej *) 

holds < a in all (R, |BFm(r, c(r, n), k)\ + 3)-good (A, <,E,P). 

Therefore by substituting i + 4r + 5 for i, we see that for alH > 1, 

(5) Q'(xi, ... , x 4r+n+6 ) if and only if 

-P(ei+8r+9 *Q, e i+8r+8> • • • j ej+4r+5) ^lj • • • j ^4r+n+6) ei+4r+5 *) 

holds < ej +4r+5 in all |BFm(r, c(r, n), fc)| + 3)-good (A, <,E,P). 

Hence by substituting ej_|_ 4r+4 , . . . , ej for xi, . . . , X4 r +5, we have that for 
all % > 1, 

(6) Q'(e i+ 4 r+ 4, ... ,ei, x 4r+6 , . . . , x 4r+n+6 ) if and only if 

-P(ej+8r+9 *Q, Ci+8r+8) ■ ■ ■ j ej+ 4r +5, ej_|_4 r+ 4, . . . , ej, X4 r+ 6, . . . , X4 r+n _|_6, ej +4r+ 5 *) 

holds < ej +4r+5 in all (R,\EFm(r,c(r,ri),k)\ + 3)-good (A,<,E,P). 

Therefore, by substituting xi, . . . , x n+ \ for X4 r+ 6, ■ ■ ■ , ^4r+n+6) we see that 
for all i > 1, 

(7) Q'(e i+ 4 r+ 4, . . . ,ej,xi,. . . ,x n+ i) if and only if 

-P(ei+8r+9 *<Z, ej + 8r+85 ■ ■ ■ , ^i, %1, ■ ■ ■ , ^n+l , ej+4r+5 *) 

holds < e i+4r+5 in all (R, |BFm(r, c(r, n), fe)| + 3)-good (A, <,E,P). 
By (2), we have 

(8) (5'(ei +4r+4 , . . . , ej, xi, . . . x n +i) if and only if 

-P(ej+8r+9 *<Z, e i+8r+8) ■ ■ ■ , Cj, Xi, . . . , X n+ i, ej +4r+ 5 *) 

holds < in all ( i?, |BFm(r, c(r, n), k)\ + 3)-good (A, <,E,P). 

By Lemma 5.43, choose p < |BFm(r, n, fe)| < c(r,n) so that for all i > 1, 

(9) Q if and only if P(ej +4r+4 *p, ej +4r+3 , . . . , ej, Xi, . . . , x n , ej *) holds < ej in 
all (R, |BFm(r, c(r, n), fc)| + 3)-good (A, <, £, P). 

Now by the definition of Q', we see that for all i > 1, 

(10) Q'(ej_|_4 r _|_4, . . . , ej, xi, . . . , x n ,p) if and only if there exists 
t < |BFm(r, n, k)\ such that p = t and 

-f( e i+4r+4 t, ej_)_ 4r -)-3, . . . , ej, Xi, . . . , X n , ej ) 

holds < ej in all (J?, |BFm(r, c(r, n), A;)| + 3)-good (A, <,E,P). 
Hence by (9) and (10), for all i > 1, 

(11) <2'(ej + 4 r+ 4, . . . , ej, xi, . . . x n ,p) if and only if Q if and only if 

P(&i+Ar+A Pi ej+4r+3) • • • j 6j , Xi , . . . , X n , ej ) 

holds < ej in all (R, |BFm(r, c(r, n),k)\ + 3)-good (A, <,E,P). 
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Also by (8), for alH > 1, 

(12) Q'(e i+4r+ 4, ...,ei,xi,.. .,x n ,p) if and only if 

P(ei+8r+9 9, ej+8r+8) • • • , &i , %1 , . . . , X n ,p, ej+4 r+ 5 *) 

holds < a in all (R, |BFm(r, c(r, n), fc)| + 3)-good (A, <,E,P). 
Hence by (11) and (12), for all i > 1, 

(13) Q if and only if 

P( e i+8r+9 *Q, ei+8r+8, ■ ■ ■ , #1, . . . X n ,p, ej + 4 r+ 5 *) 

holds < in all (R, |BFm(r, c(r, n), k)\ + 3)-good (A, <,E, P), as required. □ 

We streamline the information contained in Lemma 5.45. To this end, we 
let Z(p) for p > be the set of fc-tuples such that the first p + 1 coordinates 
are not all equal, and the first coordinate is not the maximum coordinate. 

Let p, q > 0. We say that R is a (p, q)-roi if and only if 

(i) R C A k x ,4 fe ; 

(ii) i? is order invariant as a subset of A 2k ; 
(hi) R(x,y) implies x £ Y(p) U Z(q). 

We say that (^4, <,E, P) is (i?,p, g)-good if and only if it obeys conditions 
(i)-(vi) in Lemma 5.34, where in (iv) and (v), we restrict x to be in Y(p)[JZ(q). 

LEMMA 5.46. Let r,n > 1 and |BFm(r, c(r, n), k)\ + 8r + 2ra + 12 < k. 
Then there exists a 1- empty (|BFm(r, c(r, n), k)\ +3,2)-roi R such that 

(a) For all (R, |BFm(r, c(r, n), fe)| + 3, 2)-good (A, <, E, P), (A, <) is a count- 
able linear ordering with a least element, in which every element of A has 
an immediate successor, and E is an unbounded set of limit points in A 
of order type uj; 

(b) Let Q € BFm(r, n, k) . Then there exists p < c(r, n) such that for alii > 1, 

Q if and only if P(a, ej+sr+ll , P, x\, ... ,x n ,e*) 
holds < e, in all (R, |BFm(r, c(r, n), k)\ + 3, 2)-good {A, <,E,P). 

Proof. By Lemma 5.44, let R be a |BFm(r, c(r, n), k)\ + 3-roi that sharply 
handles [BFm(r, n, fc), BFm(r, c(r, n), fe)]. We will construct a 
|BFm(r, c(r, n), k)\ + 3-extension i?' of R as required. Since R' will be a 
|BFm(r, c(r, n), k) \ + 3-extension of R, claim (a) is immediate from Lemma 
5.44. 

We have only to replace 

-P(ei+8r+9 *Q, e«+8r+8> ■ ■ ■ , ^i, X\, . . . , X n ,p, ej+4 r+ 5 *) 

in Lemma 5.45 by P(ej, . . . , ej +8r+11 ,p, x\, . . . , x n , ej *). But we can arrange 
i?' to ensure that for all \x,p\ < e^, 

P(ei *2, e i+ i, . . . , e i+8r+ i ,p, a?i, . . . , x n , e» *) 
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if and only if -P(ej +8r +9 *q, e i+8r +8, ■ ■ ■ , ej, %i, ■ ■ ■ , x n ,p, e i+4r+5 *). And then 
we can also arrange R' to ensure that if \x,p\ < ej, then 

P(e, , . . . , e i+8r +ii ,p, xi, . . . , x n , e, *) 

if and only if 

->P(e, *2, e i+ i, . . . , e i+8 r+w,P, x 1 ,...,x n ,e i *) 

if and only if 

P(e«+8r+9 *<7, ej+sr+s, ■ • • , x±, . . . , X n ,p, ej + 4 r+ 5 *) . □ 

We now wish to sharpen Lemma 5.46 in order to include a transfinite 
induction principle. 

Lemma 5.47. Let r, n > 1 and |BFm(r, c(r, 2n), fe)| + 8r + 4n + 12 < fe. 
Then there exists a 1- empty (|BFm(r, c(r, 2n), fe)| +3,3)-roi P suc/t i/iai 

(a) Por a// (P, |BFm(r, c(r, 2n), fe)|+3, 3)-good (A, <,E, P), (A, <) is a count- 
able linear ordering with a least element, in which every element of A has 
an immediate successor, and E is an unbounded set of limit points in A 
of order type u>; 

(b) Let Q G BFm(r, 2n, k). Then there exists p < c{r,2n) such that for all 
i > 1, 

Q if and only if P(e,, . . . ,e i+8r+ u,p,Xi, . . . ,x 2n ,eC) 

holds < a in all (R, |BFm(r, c(r, 2n),k)\ +3,3)-good (A,<,E,P); 

(c) The following holds in all (P, |BFm(r, c(r, 2n), fc)|+3, 3)-good (A, <,E, P): 
Let Q G BFm(r, 2n, k), i > 1, x G A n , and \x\ < ej. If there exists y G A n , 
\y\ < ej, suc/i that Q(x,y) holds < ej, i/ien t/iere is a lexicographically least 
y G A n such that \y\ < ej and Q(x,y) holds < ej. 

Proof. Let P be according to Lemma 5.46 with n replaced by 2n. Then P 
is a 1-empty (|BFm(r, c(r, 2n), k)\ + 3, 2)-roi. We will construct a 
(|BFm(r, c(r, 2n, k)\ +3, 2)-extension P' of P as required. 

According to Lemma 5.34 (iv), (v), we can arrange R 1 such that the fol- 
lowing holds. Let (A, <, E, P) be (R' , |BFm(r, c(r, 2n), k)\ +3,3)-good. For 
all i > 1 and p, x±, . . . , x n < ej, 

(1) P(ej*3,ej + i,...,ej +8 r+i2,P,zi,...,x n ,ej*) if and only if there ex- 
ists x n+ i,...,x 2n G -4, x n+ i,...,x 2n < ej, such that -P(ej, . . . , e i+8 r+n,P, 
xi, . . . , X2n, *) if and only if there exists lexicographically least x n+ \, . . . , x 2n 
G A, x n+ i, ... ,x 2n < ej, such that -P(ej, . . . , ej +8r +ii,P, £i, • • ■ ,x 2n ,ej *). 

Now let Q G BFm(r, 2n, k). By Lemma 5.46, let p < e\ be such that the 
following holds. Let i > 1, x\, . . . , x 2n G A, xi, . . . , x 2n < ej. Then 
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(2) -iQ(xi,...,X2n) if and only if P(e,, . . . , ej+8r+n,P, xi, ■ ■ ■ , X2„, ej *) 
holds < a in all (R r , |BFm(r, c(r, 2n),k)\ + 3, 2)-good (A, <,E, P). Observe 
that (c) follows immediately from (1) and (2). □ 

We have arrived at the point where we can simplify matters by fixing 
(A, <,E,P) with certain properties, and ignoring all that has gone on before. 
This simplification process ends with Lemma 5.50. 

In the next lemma, we remove the ej * at the end of the arguments for P 
that are used in Lemma 5.47. In any linear ordering (A, <), we say that p is 
finite if and only if p is in the initial segment of A of order type u. 

Lemma 5.48. Let r,m > 1 and n > 8r+m+13. There exists (A, <, E, P) 
satisfying the following conditions: 

(i) (A, <) is a countable linear ordering with a least element in which every 
element has an immediate successor; 

(ii) E = {e\ < e2 < • • • } is an unbounded set of limit points of A; 

(iii) P C A 8r+m+n ; 

(iv) Let Q G BFm(r, 2n, 8r + m + 13) have at most the free variables 
x±, . . . , x m . Then there exists finite p such that for all i > 1, 

Q if and only if P(e i} . . . , e i+8r+ n,p, Xi, . . . x m ) 

holds < ef, 

(v) Let Q G BFm(r, 2n,8r + m + 13), i > 1, x G A n , and \x\ < ej. If there 
exists y G A n , \y\ < ej, such that Q(x,y) holds < ej, then there is a 
lexicographically least y G A n such that \y\ < ej and Q(x,y) holds < ej; 

(vi) E is a strong set of atomic indiscernibles for P. That is, for all 1 < i < 
8r+m+13, andx,y G E l of the same order type, and z G y 4 8r + m + 13 -* ; an d 
coordinate permutations ir ofA 8r+m+13 , if\z\ < min(x,y), then P(ir(x, z)) 
if and only if P(ir(y, z)). 

Proof. Let k = max(8r + m + 13, |BFm(r, c(r, 2n), k)\ + 8r + 4n + 12) = 
max(8r + m + 13, |BFm(r, c(r, 2n), c(r, 2n))| + 8r + 4n + 12). By Lemma 5.47 
and Lemma 5.34, let (A, <, E, P), where P C A k , be such that the following 
holds: 

(a) (A, <) is a countable linear ordering with a least element in which every 
element has an immediate successor, and E is an unbounded set of limit points 
in A of order type u; 

(b) Let Q G BFm(r, 2n, k) have at most the free variables x\, . . . , x m . Then 
there exists finite p such that for alH > 1, 

Q if and only if P(ej, . . . , e i+8r +ii,P, xi, . . . ,x 2n ,e*) 
holds < ej in (A, <,E,P); 
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(c) Let Q G BFm(r, 2ra, k), i > 1, x G A n , and \x\ < e^ If there exists 
y G A n , \y\ < ej, such that Q(x,y) holds < ej, then there is a lexicographically 
least y G A n such that |y| < e« and Q(x,y) holds < e^; 

(d) P is a strong set of atomic indiscernibles for P. That is, for all 1 < i < k, 
and x,y G E l of the same order type, and z G A k ~ l , and coordinate permuta- 
tions 7T of if |z| < min(x, y), then P(ir(x, z)) if and only if P(ir(y, z)). 

Now let P' C A 8r+m+13 be defined by P'(yi, . . . , ysr+m+is) if and only if 

P(yi, • • • ,y8r+m+13,yi *)■ 

Let Q' G BFm(r, 2n, 8r + m + 13). We claim that there exists Q G 
BFm(r, 2n, A:) such that Q has the same free variables, and for all i > 1 and 
all assignments < e« to the free variables, 

Q holds < ej in (A, <,P) if and only if 

Q' holds < ei in (A,<,P'). 

To see this, just let Q be the result of replacing each atomic subformula 

P(zi, ... , Zgr+m+w) Of Q' by P(Z1, ... , ZSr+m+13, Z\ *). 

For (iv), let Q' £ BFm(r, 2n, 8r + m + 13) have at most the free variables 

■El > • • • j %m ■ 

By (b), there exists finite p such that for alH > 1, 

Q if and only if P(e h . . . , e i+8r+11 ,p, x u x 2 , ■ ■ ■ , x 2n , e» *) 

holds < ei in (A, <,E,P). 

Since the free variables in Q are among x±, . . . , x m , we see that by predicate 
calculus manipulations, there exists finite p such that for all % > 1, 

Q if and only if P(ej, . . . , e i+8r +ii,P, Xi, . . .,x m ,ei *) 

holds < e,i in (A, <,E,P). 

Therefore, by the displayed equivalence, there exists finite p such that for 
all i > 1, 

Q' if and only if P' '(ei, . . . , e i+8r +ii,P, xi, ■ ■ ■ ,x m ) 

holds < ej in (A, <,E,P'). This establishes (iv). 

For (v), let Q' G BFm(r, 2n, 8r + m + 13), i > 1, x G A n , and |x| < ei. 
Construct Q G BFm(r, 2n,k) as above. Then (c) holds of Q in (A, <,P). 
We need to check that (v) holds of Q' in (A,<,P'). Suppose there exists 
y G A n , |y| < ei, such that Q'(x,y) holds < in (A, <,P'). Then there exists 
y G A n , \y\ < ei, such that Q(x,y) holds < ei in (A,<,P). Hence there is 
a lexicographically least y G A n such that |y| < ei and Q(x,y) holds < ei in 
(A, <,P). This same y must be the lexicographically least y G A™ such that 
|y| < ei and Q'(x,y) holds < ei in (A, <,P'). 

For (vi), note that E is a strong set of atomic indiscernibles for P. Now let 
1 < i < 8r + m + 13, and x,y G E % of the same order type, and z G A 8r+m+13 ~ l , 
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and 7r be a coordinate permutation of A 8r+m+ls , anc [ | z | < min(x, y). It suffices 
to verify that P(ir(x, z), tt(x, z)\ *) if and only if P(ir(y, z), ir(y, z)\ *). 

First assume that tt(x, z)\ is some Zj. Then n(y, z)\ = ir(y, z)\ = Zj. Note 
that P(tt(x, z), Zj *) if and only if P(ir(y, z), Zj *) easily follows from the strong 
atomic indiscernibility of E for P. 

Finally assume that n(x, z)\ is some x q . Then 7r(y,z)i = y q . But 

P(ir(x,z),x q *) 

if and only if P{ir{y, z), y q *) also easily follows from the strong atomic indis- 
cernibility of E for P. □ 

We now apply compactness to make Lemma 5.48 more usable. We define 
BFm(r, oo, k) as the union over n of BFm(r, n, k). 

Lemma 5.49. Let r,m > I. There exists (A, <, E, P) satisfying the fol- 
lowing conditions: 

(i) (A,<) is a linear ordering with a least element in which every element has 
an immediate successor; 

(ii) E = {ei < e2 < • • • } is an unbounded set of limit points in A; 

(iii) P C A 8r+m+13 ; 

(iv) Let Q G BFm(r, oo,8r + m + 13) have at most the free variables 
Xi, . . . , x m . Then there exists u < e± such that for all i > 1, 

Q if and only if P(e i: e i+8 r+ii,u, x\, . . . , x m ) 

holds < e^ 

(v) Let i, n > 1, Q £ BFm(r, oo, 8r + m + 13) with at most the free variables 
x\, . . . ,X2n, x G A n , and \x\ < e^. If there exists y £ A n , \y\ < ei, such 
that Q(x,y) holds < ei, then there is a lexicographically least y £ A n such 
that \y\ < e,i and Q(x,y) holds < ei; 

(vi) E is a strong set of atomic indiscernibles for P. That is, for all 1 < i < 
8r + m + 13, and x,y G E % of the same order type, and z G J 4 8r + m + 13 -* ; 
and x,y G E l of the same order type, and z G A Sr+m+1 ' i ~ t , and coordinate 
permutations ir of E 8r+m+13 , if \z\ < min(x,y), then P(ir(x,z)) if and 
only ifP(ir(y,z)). 

Proof. Apply compactness to the integer parameter n in 5.48. In order 
to make Lemma 5.48 first order, we weaken "finite p n in (vi) to "p < e\." We 
obtain (i)-(vi) above without E being unbounded in A. We then cut down to 
the initial segment determined by E. □ 

For ease of applications, we need a modified form of (v) and a sharper 
form of (vi). 
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Below, it is convenient to distinguish the parameters from the free vari- 
ables in a formula. The parameters in a formula are just the free variables 
which have been assigned a particular object. 

Lemma 5.50. Let r, m > 1. There exists (A, <, E, P) satisfying the fol- 
lowing conditions: 

(i) (A, <) is a linear ordering with a least element in which every element has 
an immediate successor; 

(ii) E = {ei < e2 < • • • } is an unbounded set of limit points in A; 

(iii) P C A 8r+m + 13 ; 

(iv) Let Q £ BFm(r, oo,8r + m + 13) have at most the free variables 
x±, . . . , x m . Then there exists u < e\ such that for all i > 0, 

Q if and only if P(e,, . . . , e i+S r+ll,u, Xi, . . . , x m ) 

holds < ef, 

(v) Let i > and Q £ BFm(r, oo, 8r + m + 13) have one free variable and any 
number of parameters. If there exists x < ej, such that Q(x) holds < ei, 
then there is a least x such that Q(x) holds < e^; 

(vi) E is a strong set ofm-ary indiscernibles for BFm(r, oo, 8r + m + 13). That 
is, let Q(xi, . . . , Xm) € BFm(r, oo, 8r + m + 13), where all free variables 
are shown. Let < j < m, i > 0, x,y € E 3 be of the same order type, 
z G A m ~ 3 , \z\ < mm(x,y), and \x,y\ < e^. Then Q(x,z) holds < ei if and 
only ifQ(y,z) holds < ei. 

Proof. Let (A, <,E,P) be as in Lemma 5.49, except that we throw away 
min(E'). This enables us to use % > in (vi) and (v) instead of i > 1. 

To obtain (v), let Q(u\, . . . ,u n ,x) G BFm(r, oo,8r + m + 13), where 
u\,...,u n < ej are parameters, x is a variable, and i < j. Assume that 
there exists x < ei such that Q(u±, . . . ,u n ,x) holds < e«. We can find Q' € 
BFm(r, oo, 8r + m + 13) with n + 2 variables and no parameters such that for 
all x < ei, 

Q' (ei, u\, . . . , u n , x) holds < ej if and only if 

Q{u\, . . . , u n , x) holds < ej. 

By adding n dummy variables to x, we see by Lemma 5.49 (v) that there is a 
least x such that Q'{ei,u\, . . . , u n , x) holds < ej. Hence there is a least x such 
that Q(u\, . . . , u n , x) holds < ej. 

Now let Q, j, i, x, y, z be as given in (vi). By (iv), let u < e\ be such 

that 

Q{x\, . . . , Xm) if and only if 
P(e,, . . . ,e i+8r +ii,u,x 1 , . . .,x m ) 

holds < ej. 
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Then 

Q(x, z) holds < ej if and only if 
P(ej, . . . ,e i+8r +ii,u,x,z) 

and 

Q(y, z) holds < if and only if 
P(ei, . . . ,ej+8r+ii, u,y, z) . 
Hence by the strong atomic indiscernibility in Lemma 5.49 (vi), we have 
Q(x, z) holds < ej if and only if 
Q(y, z) holds < e*, 

which completes the proof. □ 

5.5. Existence of pairing functions defined by bounded formulas. We now 
introduce some new complexity classes which are more convenient than the 
BFm we have been using. 

The formulas under consideration are all based on the fc-ary predicate 
symbol P and <,=. No constant symbols are allowed. We use the infinite 

collection of variables, x±, X2, We inductively define the complexity classes 

~BF(i,k) and PBF(z, for i > and k > 0, as follows. (Here BF means 
"bounded formula" and PBF means "propositional combination of bounded 
formulas." 

BF(0, k) consists of the atomic formulas in this language. 
BF(i + 1, k) consists of all formulas of the form 

(3y 1 ,...y p )(y 1 < z x k . . . hy p < z p kB) 

where p > 0, B G PBF(i, k), and yi,...y p , z±, . . . z p are variables, and no z is 
the same as any y. 

PBF(? , k) consists of all propositional combinations of elements of BF (i , k) . 

Note that every element of PBF(i, k) is almost an element of BFm(i, oo, k). 
The minor difference is that we allow all propositional combinations of ele- 
ments of BF(i,/c). For B € PBF(i,fc), we can normalize the propositional 
combinations used in the construction of B so that the variant B* is literally 
in BFm(i, k). Note that B and B* are logically equivalent in the sense of first 
order predicate calculus. 

Let B € PBF(i, k) and (A, <,P) be given, P C A k . Assume that all free 
variables of B have been assigned elements of A that are all < x. We say 
that B holds < x if and only if B holds when all quantifiers are restricted to 
{y G A:y < x}. 

Lemma 5.51. Let i > 0, k > 0, B G PBF(i,fc). Let (A,<,P) be such 
that (A, <) is a linear ordering and P C A k . Let x G A and s be an assignment 
to the free variables of B, where all values of s are < x. Then 
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B holds in (A, <, P) under s if and only if 
B holds < x in (A, <, P) under s if and only if 
B* holds < x in (A, <,P) under s. 

Proof. By induction on B. We need only be concerned with the first two 
displayed statements since B and B* are logically equivalent. 

Assume this is true for B. We must show that it is true for C = (3 y\, . . . y p ) 
iyi < zi & ... & y p < ZpSzB), where no z is the same as any y. Let s be an 
assignment to the free variables of C, where all values of s are < x. Then 

C holds in (A, <, P) under s if and only if 
(3u\, . . . Up)(u\ < s(z±) & ... & Up < s{zp) & B holds in 
(-4, <,E,P) under s adjusted by {(yi,«i), • • • , (y p ,u p )}). 
The right hand side is equivalent to 

(3 u\ . . . u v < x){u\ < s(z\) & . . . hup < s{zp) & B holds < x 
in (A, <,P) under s adjusted by {(yi,iti), . . . , (y p ,u p )}). 
This is equivalent to 

C holds < x in (A, <,P) under s. □ 

We now restate Lemma 5.50 for the new and more usable complexity 
classes. 

Lemma 5.52. Let r, m > 1. There exists (A, <, E, P) satisfying the fol- 
lowing conditions: 

(i) (A,<) is a linear ordering with a least element in which every element has 
an immediate successor; 

(ii) E = {ei < e2 < • • • } is an unbounded set of limit points in A; 

(iii) P C A 8r+m+13 ; 

(iv) Let Q G PBF(r, 8r + m + 13) have at most the free variables x±, . . . , x m . 
Then there exists u < e\ such that for all i > and x\,..., x m < ej, 

Q z/ and on^y if P(ej, . . . , ej +8r +n, w, Xi, . . . , X m ) 

holds in (A, <,P); 

(v) Let Q G PBF(r, 8r + m + 13) /iai>e one /ree variable and any number of 
parameters. If there exists x such that Q(x) holds in (A, <,P), then there 
is a least x such that Q(x) holds in (A, <,P); 

(vi) E is a strong set of m-ary indiscernibles for PBF(r, 8r + m + 13). That 
is, let Q(x±, . . . , x m ) G PBF(r, 8r + m + 13), where all free variables are 
shown. Let < j < m and x, y G Ej be of the same order type, and 
\z\ < min(x,y), z G A m ~i . Then Q(x,z) if and only if Q(y,z) holds in 
(A,<,P). 
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Proof. Let r, m > 1. Let (A, <,E, P) be according to Lemma 5.50. Let Q 
be as given in (iv). By Lemma 5.50 (iv), let u < e± be such that for all % > 0, 

Q* if and only if P(e i: . . . , e i+8 r+ii, u, xi, . . . ,x m ) 

holds < ei, where Q* is as defined just before Lemma 5.51. Then (iv) follows 
by Lemma 5.51. 

Let Q be as given in (v). Choose j such that all parameters are < ej and 
there exists x < ej such that Q{x). Then by Lemma 5.51, there exists x < ej 
such that Q*(x) holds < ej with these parameters. By Lemma 5.50 (v), there 
is a least x such that Q*(x) holds < ej with these parameters. By Lemma 5.51, 
this least x is also the least x such that Q(x) holds with these parameters. 

Let Q, j, x, y, z be as given in (vi). Let \x,y\ < e q . Then by Lemma 5.50 
(vi), Q*(x,z) holds < e q if and only if Q*(y,z) holds < e q . By Lemma 5.51, 
Q(x, z) if and only if Q(y, z). □ 

We now fix r, m, and (A, <, E, P) according to Lemma 5.52. We will 
henceforth assume that r, m > 7. Recall that P C A 8r+m+13 . 
We now develop a pairing mechanism within (A, <,E,P). 
We define the linear ordering <* on A 2 by (a, b) <* (c, d) if and only if 

(i) \a, b\ < |c, d\; or 

(ii) \a,b\ = \c,d\ and (a, b) is lexicographically earlier than (c,d). 

An initial pairing function (ipf) is a partial binary function / from A 2 into 
A satisfying the following conditions: 

(i) dom(/) is of the form {(a, b): (a, b) <* (u,v)}, for some u,v £ A; 

(ii) rng (/) is of the form {c: c < w} for some w G A; 

(iii) / is order-preserving in the sense that (a, b) <* (a', b') if and only if 
f(a,b)<f(a',b'). 

Note that u, v, w above are uniquely determined from /. Accordingly, we 
say that / is an ipf of type (u, v, w). 

Note that if / is an ipf of type (u,v,w), then the extension f + = fU 
{(u,v,w)} is an ipf of type (u',v',w'), where (u',v') is the successor of (u,v) 
in <* and w' is the successor of w. That is, / + is the successor of the ipf /. 

Lemma 5.53. Let f , g be ipf's and x 6 dom (/) n dom (g). Suppose that 
for all y <* x, f(y) = g(y). Then f(x) = g(x). 

Proof. Let /, g, x be as given. Let / be of type (it, v, w) and g be of type 
(vf ,v' ,w'). Then f(x),g(x) < min(iw, w'). In particular let f(x) = g(z). 

If z <* x, then by order preservation, f(z) < f{x) = g(z), contradicting 
the hypotheses. 

Now suppose x <* z. Then g(x) < g(z) = f(x). Let y be such that 
f(y) = 9{x). Since f(y) < f(x) we have y <* x. Hence f(y) = g(y) = g(x), 
which is a contradiction. 
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We have thus shown that z = x, and so fix) = g(x), as required. □ 

Let x £ A 8r+m+10 , a nd i > 0. We write T{i,x) for the 3-ary relation 
on A defined by T(i, x) = {(a, b, c):a,b,c < eik, P(x±, . . . , x% r+m+ \o, a, b, c)}. 
T(i,x) is only defined for x e ^8r+m+io_ 

Lemma 5.54. Every bounded subset of A 3 that is definable by a formula 
in PBF(r, 8r + m + 13) with m — 3 parameters and three free variables is of the 
form T(i, x), for some i, x. Furthermore, if the set is contained in {a: a < e,} 3 , 
then it is of the form T(i,x), for some x. 

Proof. Let Q = Q(h, . . . , b m - 3 , x m -2,x m -i,x m ) define the set 

X C {a: a < ej 3 , 

where the 6's are the parameters and the x's are the free variables, and where 
Q <G PBF(r, 8r + m + 13). Let h, . . . , b m _ 3 , a < ej. 

By Lemma 5.52 (iv), let u < e\ be such that for all x±, . . . , x m < ej, 

Q if and only if P(ej, . . . , ej +8r +ii, u, x 1 , . . . ,x m ). 

Then for all x m - 2 ,x m -i,x m < e,, 

Q(h,..., bm—3} x m —2, x m —\, x m ) holds if and only if 

P(ej, . . .,e j+ s r +u,u,bi, . . . , 6 m _ 3 , x m _ 2 , x m -i, x m ) if and only if 

-^'(^) V) (x m —2 j Xm~li %m)i 

where y = (ej,..., e j+8r +ii,u, h, . . . , 6 m _ 3 ), as required. □ 

We are particularly interested in the condition that T(i, x) is (the graph 
of) an ipf. 

Lemma 5.55. Let i > 0. Any two ipf 's of the form T(i, x) are comparable 
in the sense that one is included in the other. 

Proof. Suppose T(i, x) and T(i', x') are ipf 's that disagree somewhere. By 
applying the least element principle from Lemma 5.52 (v) three times, we see 
that there is a lexicographically least triple (a, b, c) such that 

a = \b, c| < ej, and T(i, x)(b, c) / T(i', x')(b, c) . 

Then (b,c) is <*-least such that T(i,x)(b,c) / T(i' ,x')(b,c). But this contra- 
dicts Lemma 5.53. (We have used r > 7.) □ 

Lemma 5.56. Let i > and T(i, x) be an ipf. 

(i) For all (a,b) € dom(T(i,x)), T(i,x)(a,b) > a,b; 

(ii) The type (u,v,w) ofT(i,x) obeys u,v <w. 

Proof. To establish (i), it suffices to show that for all (0, a) G dom (T(i, x)), 
T(i,x)(0,a) > a. By the least element principle in Lemma 5.52 (v), let a be 
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least such that T(i,x)(0,a) < a. Let T(i,x)(0,a) = b. Then T(i,x)(0,b) < 
T(i,x)(0,a) = b. This contradicts the minimality of a. 

Let the type of T(i,x) be (u,v,w). Suppose w < u or w < v. Then 
(w,w) <* (u,v), and so (w,w) is in the domain of T(i,x). From the type of 
T(i,x) we have T(i,x)(w,w) < w. But this contradicts (i). □ 

Lemma 5.57. There exists B e PBF(2, 8r + m + 13) with 8r + m + 14 

free variables, such that the following holds. Let i > 0, x G j\Sr+m+io^ an( ^ 
\x\,u, v,w < ej. Then 

B(ei,x,u,v,w) if and only if 
T(i,x) is an ipf of type (u,v,w). 

Proof. Recall conditions (i)-(iii) in the definition of ipf. T(i, x) defines 
a function, and conditions (i) and (ii) can be put in PBF(2, 8r + m + 13). 
Condition (hi) can be put in complexity class PBF(1, 8r + m + 13). □ 

For < i < j, let T*(i,j) be the union of all ipf's of the form T(i,x), 
where \x\ < ej. 

Lemma 5.58. (i) There exists B G PBF(3, 8r + m + 13) with five free 
variables such that for all < i < j and a,b,c < ej, 

B(ei, ej,a, b, c) if and only if 

T*(i,j)(a,b) =c; 

(ii) T*(i,j) andT*(i,j) + are ipf's; 

(hi) There exists C £ PBF(5, 8r + m + 11) with five free variables such that for 
all < i < j and a,b,c < e^, 

C(ei,ej,a,b,c) if and only if 

T*(i,j)+(a,b)=c. 

Proof. By Lemma 5.55, T*(i,j) is an order preserving function from an 
initial segment of <* onto an initial segment of <. We don't know yet that 
these initial segments are determined, respectively, by elements of A 2 and A. 
This is what is required to establish (ii). 

Now (i) is easily verified from Lemma 5.57. The crucial point here is that 
a large block of existential quantifiers is used, which are treated as a single 
quantifier in terms of our measure of complexity. 

To establish (ii), note that by the least element principle in Lemma 5.52 
(v), there is a least element w outside the range of T*(i,j). Now observe 
that dom (T*(i,j)) C {x:x < ej}. So by three more uses of the least element 
principle, we can find a lexicographically least (\u,v\,u,v) such that (u,v) 
is outside the domain of T*(i,j). This (u,v) is the <*-least (u,v) outside 
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dom (T*(i,j)). Hence T*(i,j) is an ipf of type (u, v,w). Therefore T*(i,j) + is 
an ipf. 

For (iii), note that the type (u,v,w) of the ipf T*(i,j) is the unique solu- 
tion to the following: 

(i) \u,v,w\ < e,; 

(ii) For all (u',v') <* (u,v), T*(i,j)(u',v') is defined; 

(iii) T*(i,j)(u,v) is not defined; 

(iv) For all w' < w, w' G rng(T*(i, j)); 

(v) w G" rng(T*(z, j)). 

Thus we obtain (iii) from (i) as required, since T*(i,j) + = T*(i,j) U 
{(u,v,w)}. □ 

Lemma 5.59. Let < i < j. 

(i) T*(i,j)=T*(i,i+l); 

(ii) (3x)(T*(i,i + l)+ =T(i + l,x)); 

(iii) T*(i,i + 1)+ CT*(i + l,i + 2). 

Proof. To establish (i), let -B be according to Lemma 5.58 (i). Now by 
Lemma 5.52 (vi), for all a,b,c < ej, 

£?(ej, ej, a, 6, c) if and only if 

B(ei,e i+ i,a,b, c). 

Hence for all a,b,c < ej, T*(i,j)(a, b) = c if and only if T*(«, z+l)(a, 6) = c, 
as required. 

For (ii), first observe that by Lemma 5.58 (iii), T*(i,i + 1) + C 
{a: a < ej + i) 3 } is PBF(5,8r + m + 13)-definable with 2 parameters. Hence 
(ii) follows by Lemma 5.54. 

For (iii), fix k > i + 1 so that there exists \x\ < with T*(i,i + 1) + = 
T(i + 1, x). This can be regarded as a statement in PBF(6, 8r + m + 13) about 
ej+i, efc. Hence by the indiscernibility in Lemma 5.52 (vi), we can replace 
efc by e i+2 . 

We have thus shown that T*(i, i + 1) + is of the form T(i + 1, x), for some 
x < ei + 2- Therefore, (iii) follows immediately by the definition of T*(i + 1, 
i + 2). □ 

Lemma 5.60. Let i > 0. Then T*(i,i + 1) is an ipf of type (0,ei,ei). 

Proof. Let T*(i,« + 1) be of type (u,v,w). Then u,v,w < ej. Also T*(i, 
z + l) + (n, = w;. By Lemma 5.56 (ii), u,v < w < ei. 

We first establish that tt; = ej. Suppose iw < ej. Then u,v,w < ej. 
Now clearly (u,v,w) G T*(i,i + l) + \T*(i,i + 1). Hence by Lemma 5.59 (iii), 
(u,v,w) G T*(i + l,i + 2)\T*(i,i + 1). Let B be as given in Lemma 5.58 
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(i) . Then B(ei+i,ei+2,u,v,w) and ->B(ei, ej+i, u, v, w). This contradicts the 
indiscernibility in Lemma 5.52 (vi). Hence w = ej. 

Now suppose u, v < ej. As argued previously, (u,v,ei) G T*(i+l,i+2). By 
Lemma 5.58 (i), i?(ej+i, ej+2, w, v, e%). So by the indiscernibility in Lemma 5.52 
(vi), we have B(ei + 2, ej+3, u, v, ej+i). Hence by Lemma 5.58 (i), (u, u,ej+i) G 
T*(i + 2,i + 3). But («,v,ei) G T*(i + l,i + 2) C T*(i + 2,i + 3), which 
contradicts (u, v, ej+i) G T*(i + 2, i + 3). 

Hence u = e; or w = ej. This implies that dom (T*(i,i + 1)) = 
{a: a < ej} 2 . Hence (u,v) is the least upper bound of {a: a < e{\ 2 , which 
is (0, ej), as required. □ 

We now let T# be the union over i > of all T*(i, i + 1). 

Lemma 5.61. (i) For all i > 0, T# is a bijection from {a: a < ej} 2 onto 
{a: a < ej}; 

(ii) There is a formula B G PBF(3, 8r + m + 13) ioit/j /ive /ree variables such 
that for all < i < j and x,y,z < ej, 

T*(x,y) = z if and only if B(ei, ej , x,y, z) ; 

(iii) T# is a bijection from A 2 onto A. 

Proof. By Lemmas 5.59 (iii) and 5.60, the T*(i,i + 1) are comparable ifp's 
which are themselves bijections from {a: a < e,{\ 2 onto {a: a < e-i}. Hence (i) 
follows. 

Let < i < j. By Lemmas 5.59 (i) and 5.60, T#|{x:x < e^} 2 = 
T*(i, i + 1) = T*(i,j). So (ii) follows from Lemma 5.58 (i). 

Obviously (iii) follows from (i) since E is unbounded in A. □ 

We extend the binary function T# to a function that applies to any number 
(at least one) of arguments from A. Define T&(x) = x. For k > 2 we define 
T # (xi, . . . , x k+1 ) = T*(T*(xi, x k ), Xfc+i). 

5.6. Existence of linearly ordered binary relations with pairing function, 
limit points, strong indiscernibles, comprehension, and the least element prin- 
ciple. 

Lemma 5.62. (i) For all i,k > 0, T # is a bijection from {a: a < e{\ k 
onto {a: a < ej}; 

(ii) There is a formula B G PBF(4, 8r + m + 13) with k + 3 free variables such 
that for all k > 0, < i < j, and x±, . . . , x k , y < ej, 

T # (xi, . . . ,x k ) =y if and only if B(e i ,e j ,x 1 , . . . ,x k ,y) 

holds in (A, <,P); 

(iii) For all k > 0, T# is a bijection from A k onto A. 
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Proof. For (i), the case k = 2 is from Lemma 5.61. The case k = 1 is 
obvious. Assume true for k, i > 0. It suffices to show that it is true for k + 1 
and i. But this induction step is clear from the definition of T#(x±, . . . , Xfc+i). 

Clearly (ii) follows from Lemma 5.61 (ii). 

Obviously (iii) follows from (i) since E is unbounded in A. □ 

We define the important binary relation S C A 2 as follows. S(x, y) if and 
only if there exists (necessarily unique) Zi, . . . , z 8r+rn+ i2 such that 
P(zi,... ,z 8r+m+12 ,y) and T*(z x , . . . , z 8r+m+ i 2 ) = x. 

Lemma 5.63. There is a formula B € PBF(5, 8r + m + 13) with four free 
variables such that the following holds in (A,<,P). For all < i < j and 

x,y < ei, 

S(x,y) if and only if B(ei,ej,x,y) . 

Proof. Note that for all x,y < ei, S(x,y) if and only if there exists 
zi, . . . , z 8r+m+12 < ei such that P(z 1 , z 8r+m+ i 2l y) and T*(zi, . . . , 
z 8r +m+i2) = x. Hence the claim follows from Lemma 5.62 (ii). □ 

We say that B C A k is bounded if and only if there exists x <G A such that 
for all y £ B, \y\ < x. 

Lemma 5.64. Let n > and X be a bounded subset of A n that is 
definable over (A, <,P) by a formula in PBF(r — l,8r + m + 13) with any 
parameters and n free variables. Then there exist x,a G A such that X = 
{yeA n :\y\<akS(x,T#(y))}. 

Proof. Let i,t > 0, w£A\ \w\ < e i} and X = {yeA n : \y\ < eikB(w,y)}, 
where B £ PBF(r — 1, 8r + m + 13) has t + n free variables. The t coordinates 
of w serve as parameters. 

Let Y = T#[X] and v = T*(w). Using Lemma 5.62 (ii), write Y = 
{z < ef. C(ei, ej+i, v, z)}, where C £ PBF(r, 8r+m+13) has four free variables. 

By Lemma 5.52 (iv), let u < e± be such that for all z < ei, 

C(ei, ej+i, v , z) if and only if 
P(e i+2 , ... , e i+8r+ i 3 ,u, e i} e i+ i,v*m - 3, z). 
Then Y = {z < ef. S(x, z)}, where 

x = T # (e i+2 , ... , e i+8r+ i 3 ,u, ei, e i+ i,v*m - 3) . 

Hence X = {y £ A n : \y\ <a& S(x, T*(y))} as required. □ 

Let n > and X C A n . We say that X is boundedly definable over 
(A, <,P) if and only if X is bounded and X can be defined by a formula in 
PBF(cx), 8r + m + 13) over (A, <, P) with any parameters and n free variables. 
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Lemma 5.65. Letn>0 andXCA n be boundedly definable over (A, <, P). 
Then there exist x, a G A such that X = {y e A n : \y\ < ak S(x,T#(y))}. 

Proof. We show by induction on i > that this is true for complexity 
class PBF(i,8r + m + 13), with parameters allowed. By Lemma 5.64 this is 
true for PBF(r — 1, 8r + m + 13). Suppose this is true for BF(i, 8r + m + 13), 
i > r — 1. We first show that this is true for PBF(i, 8r + m + 13). 

Let X be a Boolean combination of sets of the form (y £ A n : U(y)}, 
where X is bounded and U is in BF(i, 8r + m + 13) with parameters allowed. 
Then X is also a Boolean combination of bounded sets of this form. By 
the induction hypothesis, X is a Boolean combination of sets of the form 
{y € A n : \y\ < ak S(x,T#(y))}. By Lemmas 5.62 and 5.63, X is a bounded 
set that is definable by a formula in PBF(6, 8r + m + 13) with parameters. By 
Lemma 5.64, X can be defined in the appropriate form. 

We now show that this is true for PB(i + 1, 8r + m + 13). Accordingly, let 
X = {y £ A n : \y\ < e j k(3z)(z 1 < w\ & . . . & z p < w p k B(z,y))}, where B £ 
PBF(i, 8r + m + 13), each Wi is either a parameter or some yj, parameters are 
allowed in B, and all parameters used throughout are < ej. By the induction 
hypothesis, let x, a <G A be such that for all z G A p , y £ A n , if \z, y\ < ej, then 

B(z, y) if and only if \z, y\ < ak S(x, T*(z, y)) . 

Hence for all y £ A n , y G X if and only if 

|y| < ej&(3z)(zi < Wl k . . . k z p < w p k \z, y\ < ak S(x,T*(z,y))) . 

By Lemmas 5.62 (ii) and 5.63, X is definable by a formula in PBF(6, 8r + 
m + 13) with parameters. The induction step, therefore, follows by Lemma 

5.64, and we have established the claim. □ 

LEMMA 5.66. Every nonempty subset of A that is boundedly definable 
over (A, <,P) has a least element. 

Proof. This follows immediately from Lemmas 5.52 (v), 5.62, 5.63, and 

5.65. □ 

We now consider bounded formulas in the system (A, <, S, T#). Here the 
language is based on the binary relations <, S, and the binary function T#. 

Specifically, we define BF#(0) as the atomic formulas in the language 
of (A,<,S,T&). (This will involve nested terms, as is usual in first order 
predicate calculus.) 

BF*(i + 1) consists of all formulas of the form 

(3yi, . . .,y p )(yi <hk ... k y p < t p k B) , 

where p > 0, B <G PBF*(i), yi,...,y p are distinct variables, and ti,...,t p are 
terms in which no y appears. 
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PBF*(i) consists of all propositional combinations of elements of BF*(z). 

The bounded formulas for (A, <,S, T#) are the formulas in PBF#(oo). 

A subset of A n is boundedly definable in (A, <,S, T#) if and only if it 
is bounded and definable over (A, <,S, T#) by a bounded formula with any 
parameters and n free variables. 

Lemma 5.67. For all n > and X C A n , X is boundedly definable over 
(A, <, S,T&) if and only if X is boundedly definable over (A,<,P). 

Proof. We are not claiming that every subset of A n that is definable over 
(A, <, S, T#) by a bounded formula is definable over (A, <,P) by a bounded 
formula, or vice versa. We need to know that the subset is bounded. 

Suppose that X is boundedly definable over (A, <,P). Then the repre- 
sentation of X given by Lemma 5.65 shows that X is boundedly definable over 
(A,<,S,T#). 

Now suppose that X is boundedly definable over (A,<,S,T#). Let X C 
(a: a < ei) n . Then using Lemmas 5.62 and 5.63, we can replace every atomic 
subformula appearing in the definition of X by a bounded formula with pa- 
rameters ej, ej+i, so that the definition is still valid for all arguments < e^. 
This also relies on the fact that maps each {o: a < ei} m into {a: a < e^}. □ 

We now need some more precise information. We need to refer back to 
(A,<,P). 

Lemma 5.68. Let n > 0, j > 0, and Q(x±, . . . ,x n ) £ PBF # (j) with only 
the free variables shown. Then there exists Q*(x±, . . . , x n+ 2) € PBF(j + 6, 
8r + m + 13) with only the free variables shown such that the following holds. 
For all i > and x\, . . . ,x n < e,, 

Q(x\, . . . , x n ) holds in {A, <, S, T#) if and only if 

Q*(x\, . . . ,x n ,ei,e i+ i) holds in (A, <,P). 

Proof. The proof is by induction on j. We rely on the fact that T# maps 
each (a: a < e.i) m into {a: a < e^}. 

Let j = 0, and Q(x\, . . . , x n ) be as given. Let Q'(x±, . . . , x n ) be the 
obvious predicate calculus equivalent of Q obtained by putting a block of ex- 
istential quantifiers on Q and replacing all terms in Q by unnested terms. Let 
Q"(x±, . . . ,x n+ i) result from Q' by strictly bounding these existential quanti- 
fiers to x n +i. Finally, let Q*(x±, . . . ,x n+ 2) result from Q" by using the defini- 
tions of S, T# in Lemmas 5.61 and 5.63, where the two parameters appearing 
there, and ej, are replaced by x n+ \ and x n+ 2- This results in the required 
Q* € PBF(6,8r + m + 13). 

Suppose this is true for PBF*(j). We handle BF*(j + 1) by changing 
the bound variables so that they are not any x±, . . . ,x n+ 2, adding additional 
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existential quantifiers to unravel the bounding terms, bounding all the relevant 
existential quantifiers to x n+ ±, and using the definitions from Lemmas 5.61 and 
5.63 as above. The resulting Q* is in PB(j+6, 8r+m+13). Finally PBF # (j'+l) 
is handled by passing through the propositional operations. □ 

Lemma 5.69. Let Q(xi, . . . ,x m -2) € PBF*(r — 6) where all free variables 
are shown. Let < j < m — 2 and x,y £ E 3 be of the same order type, and 
\z\ < min(x,y), z £ A m ~ 2 ~ J . Then Q(x,z) if and only ifQ(y,z) holds in 
(A,<,S,T#). 

Proof. Let Q, j, x, y, z be as given. Let \x, y\ < and Q*(x±, . . . , x m ) be 
according to Lemma 5.68. Then Q* G PBF(r, 8r + m + 13). By Lemma 5.52 
(vi), we have 

Q*(x, z, e,, e i+ i) if and only if Q*(y, z, e,, e i+1 ) 

holds in (A, <, P). By Lemma 5.68 we see that Q(x, z) if and only if Q(y, z) 
holds in (A, <, S, T#) as required. □ 

We now transfer entirely over to (A, <, E, S, T#) and never consider P 
again. From now on, we say that X C A n is boundedly definable if and 
only if X is bounded and can be defined by a formula in PBF#(oo) with any 
parameters allowed. 

Lemma 5.70. The system (A, <, E, S,T&) obeys the following: 

(i) (A,<) is a linear ordering with a least element in which every element has 
an immediate successor; 

(ii) E = {e\ < e2 < • • •} is an unbounded set of limit points in A; 

(iii) 5CA 2 ; 

(iv) For alli>0,T# is a bijection from {x: x < e^} 2 onto {x: x < e^}; 

(v) Let n > and X be a boundedly definable subset of A n . Then there exists 
x,a e A such that X = {y e A 11 : \y\ < at S(x,T#(y))}; 

(vi) Every nonempty boundedly definable subset of A has a least element; 

(vii) Let Q(xi, . . . ,x m _2) G PBF#(r — 6), where all free variables are shown. 
LetO < j < m — 2 andx,y € E° be of the same order type, and \z\ < min(x, y), 
z e A m ~ 2 ~ j . Then Q(x, z) if and only if Q(y, z). 

Proof. This is immediate from Lemmas 5.65, 5.66, 5.67, and 5.69. □ 

Lemma 5.71. There exists a system (A, <,E,S,G) such that the follow- 
ing holds: 

(i) {^4, <} is a linear ordering with a least element in which every element 
has an immediate successor; 

(ii) E = {ei < e2 < . . . } is an unbounded set of limit points in A; 

(iii) SCA 2 ; 
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(iv) For all i > 0, G is a bijection from {x: x < e{\ 2 onto {x: x < e{\; 

(v) Let n > and X be a boundedly definable subset of A n . Then there exists 
x,a G A such that X = {y G A n : \y\ < at S(x, G(y))}; 

(vi) Every nonempty boundedly definable subset of A has a least element; 

(vii) Let n > and Q(xi, . . . ,x n ) be a bounded formula, where all free variables 
are shown. Let < j < n and x,y G be of the same order type, and 
\z\ < mm(x,y), z G A n ~K Then Q(x,z) if and only ifQ(y,z). 

(In (v), G is extended to A n , n > 0, by: for n = 1, G(x) = x; for n > 2, 
G(x±, . . . , Xfc+i) = G(G{x\, . . . ,Xfc),Xfe + i). Also boundedly definable refers to 
the system (A, <,S,G), where G is used instead of T#.) 

Proof. We can try to obtain this result without the unboundedness of 
E in clause (ii) from Lemma 5.70 by applying the compactness theorem for 
predicate calculus. We would like to cut down to the initial segment of A 
determined by E. But this may ruin clause (v). 

We modify this argument as follows. We treat £asa monadic predicate 
symbol (instead of an infinite sequence of constants) and replace clause (ii) 
with U E is unbounded above." We then obtain a system (A, <, E, S, G) as 
desired, except that clause (ii) reads U E is an unbounded set of limit points in 
A." We then make E of order type u by using any cofinal subset of E of order 
type oj. □ 

We now fix a system (A, <,E,S, G) according to Lemma 5.71. Henceforth, 
definability and boundedly definable will refer to (A,<,S,G). 

Lemma 5.72. Let n > 0, i > 0, and B(x\, . . . ,x n ) be a prenex formula 
with free variables shown. Let B/ei(xi, . . . , x n ) be the result of bounding all of 
the quanifiers in B to {a: a < e{\. Then for all xi, . . . , x n < ej, B(x±, . . . , x n ) 
if and only if B / ei{x\, . . . , x n ). 

Proof. By induction on the number k > of quantifiers in B, the ba- 
sis case being vacuous, we may assume that for all n > 0, i > 0, prenex 
B(x\, . . . , x n ) with k quantifiers, and xi,...,x n < e,, B(x±, . . . , x n ) if and 
only if B/ei(xi, . . . , x n ). Let B(x±, . . . , x n ) be prenex with k + 1 quantifiers 
and i > 0. 

Write B(x±, . . . , x n ) = (Qy)(C{x\, . . . , x n , y)) where C has k quantifiers. 
Let x±, . . . , x n < Choose i < j such that 

(Qy < ej)(C(xi, . . -,x n ,y)) if and only if 
{Qy)(C{xi, . . .,x n ,y)). 
By the induction hypothesis, for all y < ej, 

C(xi, . . . , x n , y) if and only if 
C/ej(xi,...,x n ,y). 
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Hence 

(Qy)(C(xi, . . -,x n ,y)) if and only if 

(Qy < ej)(C(xi, . . .,x n ,y)) if and only if 

(Qy < ej)(C/ej(xi, . . .,x n ,y)) if and only if 

B/e j (x 1 , . . . ,x n ). 
Now by the indiscernibility from Lemma 5.71 (vii), 

B/ej(x±, . . . , x n ) if and only if 

B/ei(xi, . . . ,x n ). 

Hence 

B(xi, . . . , x n ) if and only if 
B/ei(xi, . . . ,x n ), 

as required. □ 

We say that a subset of A n is definable if and only if it can be defined by 
a formula (not necessarily bounded) with any parameters from A. 

Lemma 5.73. For all n > 0, every bounded definable subset of A n is 
boundedly definable. 

Proof. This is by Lemma 5.72, where is chosen to be greater than the 
parameters used and the bound on the subset of A n . □ 

Lemma 5.74. There exists a system (A, <,E,S,G) such that the follow- 
ing holds: 

(i) (A,<) is a linear ordering with a least element in which every element has 
an immediate successor; 

(ii) E = {e\ < e2 < • • •} is an unbounded set of limit points in A; 

(iii) SCA 2 ; 

(iv) For all i > 0, G is a bijection from {a: a < e,{\ 2 onto {a: a < e^}; 

(v) Let n > and X be a bounded definable subset of A n . Then there exist 
x,a£ A such that X = {y G A n : \y\ < ak S(x, G(y))}; 

(vi) Every nonempty definable subset of A has a least element; 

(vii) Let n > and Q{x\, . . . , x n ) be a formula, where all free variables are 
shown. Let < j < n and x,y G E J be of the same order type, and 
\z\ < min(x,y), z G A n ~° . Then Q(x,z) if and only ifQ(y,z). 

Proof. This is immediate from Lemmas 5.71 and 5.73 except for (vii). Let 
n, Q, j, x, y, z be as given. We can assume that Q is prenex. Let \x,y\ < e^. 
By Lemma 5.71 (vii), 

Q/ei(x,z) if and only if Q/ei(y,z). 

By Lemma 5.72, 
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Q(x, z) if and only if Q/ei(x, z), and 
Q(y,z) if and only if Q/ei(y,z). 
Thus Q(x, z) if and only if Q(y, z), as required. □ 

5. 7. Construction of the cumulative hierarchy. 

Lemma 5.75. Let n,i > and X C {b:b < e,i\ n be definable. Then 
there exists x and a < ei such that X = {y € A n : \y\ < ak S(x,G(y))}. 
Furthermore, if this equation holds for x,a, where a < e«, then there exists 
x < ej+i such that this equation holds for x, a. 

Proof. The first claim is immediate from Lemma 5.74 (v); the bound on 
a is obtained by the hypothesis on X. 

Fix n, i > and a < e{. For all x € A, define f{x) = {y £ A n : \y\ < 
ak, S(x,G(y))}. We say that x is critical if and only if for all x' < x, f{x') / 
f{x). 

In order to complete the proof, it suffices to show that every critical x lies 
strictly below ej+i. Suppose this is false. Let z\ be the least critical x > ej+i. 
Then z\ is definable from a and ej+i. Hence by the indiscernibility given in 
Lemma 5.74 (vii), ej+i < Zi < ej + 2- 

By indiscernibility, some critical x is > ej + 2- Hence let Z2 be the least 
critical x > ej+2- Then by indiscernibility, ej+2 < ^2 < 

By the same argument, let Z3 be the least critical x > ei+3. Hence also 
ej+3 < ^3 < ej+4- 

Now we wish to compare the sets f{zi), ffa), and f(z%). Since zi, ^2, 
and Z3 are critical, these sets differ. Let y±, y2, and y^ be, respectively, the 
lexicographically least element of f(z\)Af(z2), f(z2)^f(zs), and f(zi)Af(z^). 
Note that |yi|, I2/2 1 » 1 2/3 1 < « < ej. Hence by indiscernibility, y± = 7/2 = yz- But 
this is a contradiction. □ 

We say that a partial function from A n into A is definable if and only if 
its graph is a definable subset of A n+1 . Of course, any parameters are allowed. 

Lemma 5.76. Let n > 0. Every n-ary definable function with bounded 
domain has bounded range. For all i > 0, the field of every n-ary function with 
bounded domain that is definable with parameters < is contained in some 
{a: a < x}, where x < a. 

Proof. Clearly the second claim implies the first claim. Let i > and F 
be as given. Let i < j be such that 

(3y <e j )(dom(F)Q{a:a<y} n ). 

By Lemma 5.74 (vii), 

(By < e;)(dom(F) C {a: a < y} n ) . 
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Fix such a y. By Lemma 5.74 (vii), clearly rng(i ? ) C {a: a < e{\. Hence 
(3 z < e m )(rng (F) C {a: a < z}) . 

By Lemma 5.74 (vii), 

(3 z < e;)(rng(F) C {a: a < z}) . 

Fix such a z. Then x = max(y, z) is as required. □ 

Lemma 5.77. Let B C A be definable and bounded, and x £ A. Then 
there are unique y, f such that f is a definable order-preserving map from B 
one-one onto [x, y). 

Proof. Fix B as given. Uniqueness is immediate by the least element 
principle in Lemma 5.74 (vi). 

Let K (z, w, a, b) hold if and only if 

{u G A 2 : \u\ < aSz S(b,G(u))} is an order-preserving function 

f a> b from B n [0, z) onto [x, w). 

By the least element principle, if K(z,w,a,b) and K(z,w' ,a' ,b'), then 
w = w' and f a ,b = fa',b'- Thus if K(z,w,a,b), then we can write f z for 
this unique f a ^, which is the unique definable order-preserving function from 
B n [0, z) onto [x, w), since it depends only on z. 

We prove that for all z there exists w, a, b such that K(z, w, a, b). Suppose 
this is false for some z. By the least element principle, assume z is the least 
such that this is false. 

Now for all z' < z, f z i is the unique definable order-preserving function 
from B n [0, z') onto some [x,w'). By the least element principle, for all z' < 
z" < z, f z , C f z „. 

Let g be the union of the f z i, z' < z. Then g is an order-preserving 
function from B (~l [0, z) onto an initial segment / of [x, oo). But also note that 
using the definition of the f z i, z' < z, given in terms of the definition of K, 
we see that g is definable. Hence by Lemma 5.76, the range of g is bounded. 
So by the least element principle, I must be the form [x,w). Therefore, by 
Lemma 5.74 (v), there exist a, b such that K(z,w,a,b). This is the required 
contradiction. □ 

We now develop the cumulative hierarchy within (A, <, E, S,G). An ini- 
tial cumulative hierarchy (ich) as a system (x, y, R, rk) satisfying the following 
conditions: 

(i) x,y E A; 

(ii) R C {a: a < y} 2 ; 

(iii) Let 6, c < y. If (Va < y)(R(a, b) if and only if R(a, c)), then b = c; 

(iv) rk: {a: a < y} onto {a: a < x}; 
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(v) Let a < y. Then rk(a) = sup{rk(6): R(b, a)}, where this is the strict sup; 

(vi) Let b < x and Y be a definable subset of {z: rk(z) < b}. Then there exists 
w < y such that Y = {z: R(z, w)}; 

(vii) If a < b < y, then rk(a) < rk(6). 

From the point of view of set theory, this intuitively means that 

(1) (x,y, R, rk) codes the cumulative hierarchy of height x; 

(2) the domain of the cumulative hierarchy structure is {a: a < y}; 

(3) rk is the rank function from {a: a < y} onto {a: a < x}; 

(4) for all b < x, every set of domain elements of rank < b is coded in the 
cumulative hierarchy; 

(5) for all a, b in the domain, if rk(a) < rk(6), then a < b. 
We will be using the following terminology: 

(a) x is the height of the ich; 

(b) y is the domain point of the ich; 

(c) R is the epsilon relation of the ich; 

(d) rk is the rank function of the ich. 

We say that an ich is definable if and only if its epsilon relation and rank 
function are definable (with any parameters allowed). 

Lemma 5.78. Let X = (x,y, R, rk) be a definable ich. Then there is a 
definable ich X# = (x + , y' , R', rk') such that 

(i) y < y' and rk C rk'; 

(ii) R = R' D{a:a <y} 2 . 

Proof. Let X be as given, and let y < e,. We say that (6, c) G A 2 is 
minimal over X if and only if 

(a) {a < b: S(c, a)} is different from every {a: R(a, d)}, d < y; 

(b) {a<b:S(c,a)}C [0,y); 

(c) for all (6',c') < lcx (6,c), {a < b':S(c',a)} / {a < b:S(c,a)}. 

In other words, (b, c) codes a subset of [0, y) which is not coded inside X, 
and not coded by any lexicographically earlier (6',c'). 

Let T = {G(b,c): (b,c) is minimal over X}. Clearly T is definable. Also 
observe that by Lemma 5.75, T is strictly bounded by ej+i. By Lemma 5.77, 
let /, y' be unique such that / is a definable order-preserving function from T 
onto [y,y'). 

We define R' by: R'(z,w) if and only if either (w < y & R(z,w)) or 
(3 6,c)(/(G(6,c)) = wkz < bkS(c,z)). We extend rk to rk' by setting all 
rk'(/(u)) = x. 

We now define X* = (x + ,y', R', rk'). X# obviously obeys clauses (i)-(iii), 
(vii) in the definition of ich. 

We claim that for all G(b,c) G T, x = sup{rk(z): /(G(6, c)))}. Note 
that R'{z, f{G{b, c))) if and only if (S(c, z) & z < b). 
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Suppose that this is false for some G(b, c) G T. Let x' < x be strictly- 
greater than all rk(z) for which S(c, z) Sz z < b. Then {z < b:S(c,z)} is a 
definable subset of {z: rk(z) < x'}. So by clause (vi) in the definition of ich, we 
see that {z < b: S(c, z)} is of the form {z: R(z, w)}, w < y. But this contradicts 
that G(b, c) € T. This establishes the claim. 

Hence clause (v) holds for X#. To establish (vi) for X#, let u < x + and Y 
be a definable subset of {z:ik'(z) < u}. Then Y is a definable subset of [0, y). 
By Lemma 5.74 (v), Y is of the form {a < b: S(c, a)}. By the construction of 
X# and the least element principle, we see that Y is of the form {z: R'(z, w)}, 
w < y' . 

It remains to establish clause (iv) in the definition of ich. It suffices to 
prove that there is a definable subset of [0, y) that differs from every \a:R(a, d)}, 
d < y. But {d < y: -<R(d, d)} is such a definable subset of [0, y). □ 

Lemma 5.79. Let X = (x, y, R, rk) be a definable ich and a < x. Then 
{z:ik{z) < a} is of the form [0,6), b < y. Also X \ a = (a, b, R n [0, 6) 2 ,rkn 
[0, b) 2 ) is a definable ich. 

Proof. Let X, a be as given. By clause (vii) for X, {z:rk(z) < a} is 
an initial segment of A. By the least element principle, let b be such that 
{z: rk(z) < a} = [0, b). All the clauses in the definition of ich clearly hold for 
(a, b, RC\ [0, 6} 2 ,rkn [0,6) 2 ) except for (vi). Let c < a and Y be a definable 
subset of {z:rk(z) < c}. By (vi) for X, let w < y, Y = {z: R(z, w)}. Then 
rk(w) < c < a, and hence w < b as required. □ 

For any definable ich X, we let X^ be the definable ich given by the 
construction in the proof of Lemma 5.78. Notice that X* depends on X 
and not on the definition of X (although the existence of X* depends on the 
existence of a definition of X). 

We say that X = (x, y, R, rk) is a preferred ich if and only if 

(i) X is a definable ich; 

(ii) for all a + < x, X \ a + = (X \ a)*. 

To make this more precise, we can use the representation in Lemma 5.74 
(v) of bounded definable subsets of A n to introduce codes for definable ich's 
as certain quadruples from A. Using the proof of Lemma 5.78, we then define 
a binary relation B such that for all such codes a, (3, B(a,f3) if and only if [3 
codes the # of the ich coded by a. Then the definition of preferred ich can be 
given as follows: X = (x, y, R, rk) is a preferred ich if and only if 

(i) X is a definable ich; 

(ii) for all a + < x, we have B(a,(3), where a is a code of the ich X\a and (5 
is a code of the ich X\a + . 
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Lemma 5.80. Let X, X' be preferred ich's of heights x, x' , with rank 
functions rk, rk'. For all a < x, X \ a is a preferred ich. If x < x' then 
X = X' | x. Any two preferred ich's of the same height are equal. 

Proof. Let X, X', x, x' be as given. Assume a < x. By Lemma 5.79, 
X | a is a definable ich. Let b+ < a. Then X \ a \ b + = X | b + = (X \ b)# = 
{X | a | b)#. 

For the second claim, assume x < x'. We claim that for all b < x, 
X | b = X' | b. By way of contradiction, let b be least such that X \ b ^ X' \ b. 
By clause ii) in the definition of preferred ich, clearly b is not a successor in A. 
Hence b is a limit. 

Clearly the heights of X \ b and X' \ b are both b. Also the domain, 
epsilon relation, and rank function of X \ b is the union of the domain, epsilon 
relation, and rank function of X | c, c < b. The same holds for X'. Hence 
X | b = X' | b, which is the required contradiction. 

The third claim follows from the second claim. □ 

We now introduce the predicate M(x, y, a, b, c, d) which holds if and only 
if (x,y,{z G A 2 :\z\ < ah S(b,G(z))}, {w G A 2 : \w\ < c& S{d,G(w))}) is a 
preferred ich. 

Lemma 5.81. M is definable. 

Proof. Clearly M(x, y, a, b, c, d) is equivalent to the fact that (x, y, {z G 
A 2 :\z\ < a&S{b,G(z))}, {w G A 2 : \w\ < ck S(d,G(w))}) is an ich X such 
that for all a + < x, X \ a + = (X | a)*. It remains to show that the assertion 
{x,y,{z G A 2 : \z\ < ah S(b,G(z))}, {w G A 2 : \w\ < ck, S(d,G(w)}) is an ich 
is definable. 

The only clause in the definition of ich that is problematic is clause (vi) . 
However, according to Lemma 5.74 (v), the sets Y appearing there are the sets 
of the form {y < z: S(w,y)}, for some z, w, which removes the difficulty. □ 

Lemma 5.82. For all x there exist y, a, b, c, d such that M(x, y, a, b, c, d) . 
There is a unique preferred ich of each height. 

Proof. By Lemma 5.80, there is at most one preferred ich of any given 
height. We now prove the first claim by transfinite induction, which follows 
from the least element principle and Lemma 5.81. 

Fix x such that for all x' < x, there exists y', a', b', d , d' such that 
M(x',y',a f ,c J ,c',d'). If x = 0, then there obviously exists y, a, b, c, d such 
that M(x, y, a, b, c, d). If x = x' + , then let M(x', y', a', b 1 , d , d'). Let X be the 
preferred ich of height x' coded by x', y', a', b', c', d' . We can choose x, y, a, 
b, c, d which appropriately codes the preferred ich X* of height x. 
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Finally, suppose x is a limit point in A. By the least element principle and 
Lemma 5.81, there is a definable map h: [0,x) — > A 6 such that for all x' < x, 
M(h(x')). By Lemma 5.76, the range of h is bounded. 

Now for x' < x, h(x') codes the unique preferred ich of height x' , and these 
preferred ich's are comparable according to Lemma 5.80. Let (x, y, R, rk) be 
such that y is the sup of the domain points of the h(x'), R is the union of 
the epsilon relations of the h(x'), and rk is the union of the rank functions of 
the h(x'). Then (x,y, R, rk) is a preferred ich of height x. By Lemma 5.74 
(v), choose a,b,c,d so that (x,y,a,b,c,d) appropriately codes up X. Hence 
M(x, y, a, b, c, d) as required. This establishes the first claim. The second claim 
follows. □ 

Let R be the union of the epsilon relations of the preferred ich's, and let 
rk be the union of the rank functions of the preferred ich's. 

Lemma 5.83. (A, R, rk) is a system that is definable without parameters 
in (A, <,S,G), and has the following properties: 

(i) (A, R) is extensional; 

(ii) rk is a rank function for (A, R) which is onto A; 

(iii) The inverse image of every bounded subset of A under rk is bounded; 

(iv) Let Y C A be bounded and definable in (A, <,S,G). 
Then there exists a £ A such that Y = {x: R(x,a)}. 

Proof. Observe that by a straightforward transfinite induction argument, 
if (x,y,R, rk) is a definable ich, then x < y. Clauses (i), (ii), (iv) follow from 
Lemmas 5.80 and 5.82. For clause (iii), note that rk(u) < x is equivalent to u 
being in the domain of the preferred ich of height x. □ 

5.8. Existence of a model of set theory with large cardinals, and application 
of the second incompleteness theorem. 

Lemma 5.84. (A,R) satisfies ZFC. (A, R) satisfies strong separation in 
the sense that for all bounded Y C A that are definable in (A, <, S,G), there 
exists x £ A such that Y = {a: R(a, x)} . 

Proof. Extensionality is from clause (iii) in the definition of ich. Pairing 
is from clause (vi) in the definition of ich. 

Separation is from clause (vi) in the definition of ich and the fact that 
R itself is definable in (A, <, S,G). In fact, this yields the strong form of 
separation, as stated in the lemma. 

For union, first note that R(a,b) hR(b,c) implies rk(a) < rk(c). The 
union axiom follows from Lemma 5.83 (iii) and strong separation. 
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For power set, note that by clause (v) in the definition of ich, if (V x)(R(x,a) 
implies R(x,b)), then rk(a) < rk(6). Power set then follows from Lemma 5.83 
(hi) and strong separation. 

For replacement, first use the fact that every definable function with 
bounded domain has bounded range from Lemma 5.76. Then apply Lemma 
5.83 (hi) and strong separation. (In the presence of separation, replacement is 
taken in the form (Vi £ a)(3\y) =4* (3z)(Vx G a)(3y G z).) 

For foundation, we simply use the rank function, since R(x, y) implies 
rk(x) < rk(y). 

We now come to the axiom of infinity: there exists a set x such that the 
empty set is in x, and for all sets a G x, a U {x} G x. Let Y = {a: rk(a) < e{\. 
Apply Lemma 5.83 (hi) and strong separation, together with the fact that e\ 
is a limit point, to obtain the required x. 

We have now shown that (A, R) satisfies ZF, which allows us a certain 
amount of liberty. To verify the axiom of choice, we start with what is regarded 
within (A, R) as a pairwise disjoint collection of nonempty sets. This translates 
externally (i.e., in (A, <,5, G)) into an appropriate binary relation that is 
bounded and definable. We can obviously find a choice set that is definable in 
(A, <,S,G) by taking least elements. Now apply Lemma 5.83 (hi) and strong 
separation. □ 

Lemma 5.85. Proposition A for ^-decreasing implies the consistency of 
ZFC, provably within ZFC. If ZFC is consistent, then Proposition A for #- 
decreasing cannot be proved in ZFC. 

Proof. The first claim is by Lemma 5.84, and the second claim is by the 
Godel second incompleteness theorem. □ 

We now want to show that (A, R) satisfies the existence of subtle cardinals 
of every standard finite order, thereby showing that Proposition A for #- 
decreasing cannot be proved in ZFC + {there exists a subtle cardinal of order 
k}k, assuming this augmented theory is consistent. Recall the definition of 
A;-subtle cardinals from [Ba75] discussed in Part 2: A is fc-subtle if and only if 

(i) A is an infinite cardinal; 

(ii) for all closed unbounded CCA and regressive /:5&(A) — > 5(A), there 
exists an /-homogeneous B G Sk+\ (C). 

Lemma 5.86. Let i > 0, x < ej, and F: [0, x) — ► [0, e,) be definable in 
(A, <, S,G). Thenmg(F) is bounded in [0, ej). 

Proof. Let i > and suppose that this is false for some x and F. Using 
the representation of bounded definable sets in Lemma 5.74 (v), we can find a 
counterexample x, F, where x, F are definable in (A, <,S,G) using only the 
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parameter ej. Now make the same definitions with the parameter a replaced 
by the parameter ej+i. By Lemma 5.74 (vii), this results in the same x, F. 
Now consider the true statement 

rng(F) is bounded in [0, ej+i) 

formulated with the definition of F using only the parameter ej+i. By Lemma 
5.74 (vii), the statement 

rng(F) is bounded in [0, ej) 

must hold, where the definition of F using only the parameter ej is used. This 
is the required contradiction. □ 

We say that C is a closed unbounded subset of [0, ej) if and only if 

(i) CC[0,ei); 

(ii) for all x < e% there exists x < y G C; 

(hi) for all < x < e i: if (Vy < x)(3z G C)(y < z < x), then x G C. 

Lemma 5.87. Let C be a closed unbounded subset of [0, ej) and F: 
<Sfc([0, ej)) — > 5([0, ej)) 6e regressive. Assume that C is definable in (A, <, 5, G). 
Also assume that the "characteristic relation" x £ F(y) of F is definable in 
(A, <,S,G). Then there exists an F -homogeneous B G Sk+i(C). 

Proof. Let i > 0, and suppose that there is a definable counterexample 
C, F. Using Lemma 5.74 (v), we can find a counterexample C, F, where C, F 
are definable in (A, <,S,G) using only the parameter ej. Now make the same 
definitions with ej replaced by ej+^+i. By Lemma 5.74 (vii), this results in C', 
F', where 

(1) C' is a closed unbounded subset of [0, ej + fc+i); 

(2) F':S k ([0,e i+k+1 )) S([0, e i+k+1 )) is regressive; 

( 3 ) c = c'n[o, ei y, 

(4) the characteristic relation of F is the restriction of the characteristic 
relation of F' to [0, ej). 

Hence ej G C'. So again by Lemma 5.74 (vii), ej, ej+i, . . . , ej+fc G C'. It is 
also clear by Lemma 5.74 (vii) that {ej, . . . , ej + ^} is -F'-homogeneous. Hence 
there exists an F'-homogeneous B G S k+ \{C') 

holds by the definitions with only the parameter ei+ k +i- Therefore, by Lemma 
5.74 (ii), 

there exists an F-homogeneous B G S k +i(C) 

holds using the definitions with only the parameter ej. This is the required 
contradiction. □ 

Lemma 5.88. For all a G A there exists a unique a* G A such that 
rk(a*) = a and "a* is epsilon- connected and transitive'''' holds in (A,R). (The 



FINITE FUNCTIONS AND THE NECESSARY USE OF LARGE CARDINALS 891 



statement in quotes is also written "a* is an ordinal") The * -operation is 
an order-preserving bijection from A onto the set of ordinals of (A, R) (with 
the ordinals of (A,R) ordered by R), and is definable without parameters in 
(A,<,S,G). ' 

Proof. Since (A, R) satisfies ZFC, it satisfies the classical theorem about 
comparability of ordinals - for any two distinct ordinals, the first is an element 
of the second or the second is an element of the first. Thus their ranks must 
be different. This establishes uniqueness. 

We prove existence by transfinite induction in (A, <,S,G), which is valid 
in this context because by Lemma 5.83, (A, R, rk) is definable in (A, <,S,G). 
Let a G A, and assume that for all b < a, there exists (unique) b* such that 
rk(b*) = b and b* is an ordinal in (A, R). If a = 0, then we can take the empty 
set in (A, R), and if a = b + , we can take b* U {6*} in (A, R). 

Now assume that a is a limit. Let Y = {b*:b < a}. By the strong 
separation proved in Lemma 5.84, let a' be such that Y = {c: R(c, a')}. Then 
rk(o') = a. We also claim that (A, R) satisfies that Y is transitive. To see 
this, let R(x, b*), b < a. Since b* is an ordinal in (A,R), so is x. Let rk(x) = 
c < rk(6*) = b. By the uniqueness in the previous paragraph, x = c*, and so 
x G Y. Obviously a' is a transitive set of ordinals in (A,R), and so a' is an 
ordinal in (A, R). Also rk(a') is the strict sup of the rk(6*), b < a, which is 
clearly a. 

For the second claim, the surjectivity is a consequence of the fact that 
every x G A has a rank rk(x). To check order preservation, suppose x < y. 
Then R(x*,y*) or R(y*,x*). The latter is impossible since otherwise rk(y*) = 
y < rk(x*) = x. The definability follows from Lemma 5.83. □ 

We are not claiming that * is continuous. 

Lemma 5.89. For all i > 0, "e* is a regular cardinal" holds in (A,R). 

Proof. It suffices to prove that in (A, R), the range of every function from 
an element of e* into e* has a strict upper bound < e*. Let /, x be such that 
in (A, R), u x < e* and / maps x into e*." By Lemma 5.88, let x = a* , a < ej. 
By Lemma 5.88, when viewed externally, / defines a function F: [0, a) — > e\ 
which is definable in (A, <,S,G), where for all b < a, /(&*) = F(b)* holds in 
(A, R). The lemma then follows from Lemmas 5.86 and 5.88. □ 

Lemma 5.90. For all i, k > 0, "e* is a k-subtle cardinal" holds in (A, R). 

Proof. In (A, R), let C be a closed unbounded subset of e*, and /: <Sfc(e*) — > 
S(e*). Let C' = {a: a* G C}. Then by Lemma 5.88, C' is a closed unbounded 
subset of [0, e*) that is definable in (A, <, S, G). Let F: S k ([0, a)) -» S([0, a)) 
be given by F(x) = {a: a* G f(x)}. Then the hypotheses of Lemma 5.87 apply 
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to C", F, and e«. Let B G S'fc + i(C") be F-homogeneous. Then in (A,R), 
{b*: b <G 5} is an /-homogeneous element of Sk+i(C) as required. □ 

Theorem 5.91. Proposition A for ff -decreasing implies the consistency 
of ZFC + {there exists a k-subtle cardinal}^, provably within ZFC. If ZFC + 
{there exists a k-subtle cardinaljk is consistent, then Proposition A for ff- 
decreasing cannot be proved in ZFC+{there exists a k-subtle cardinal} In fact, 
Proposition A for ff -decreasing cannot be proved from any consistent subset of 
the theorems of ZFC + {there exists a k-subtle cardinal}], from which ZFC can 
be derived. The same results hold for all forms of Propositions A-D. 

Proof. The first claim is proved by Lemmas 5.84 and 5.90. The second 
claim is proved by Godel's second incompleteness theorem. 

For the third claim, we use A for "Proposition A for ^-decreasing." We 
fix a finite fragment ZFC' of ZFC which suffices to prove the implication "A 
implies the consistency of ZFC + {there exists a /c-subtle cardinal}^." Let T 
be any consistent subset of the theorems of ZFC + {there exists a /c-subtle 
cardinally that derives ZFC + A. Let T' be a finite subset of T that derives 
ZFC' + A. Then ZFC + T' is consistent since its axioms are included in the 
theorems of T. Also ZFC + T' proves the consistency of ZFC + {there exists a 
/c-subtle cardinal} fe. Now T' is a finite set of theorems of ZFC + {there exists a 
/c-subtle cardinal}*;, and hence also ZFC + T' proves this fact. Hence ZFC + T' 
proves its own consistency. This contradicts the consistency of ZFC + T" by 
the Godel second incompleteness theorem. 

The fourth claim follows immediately from Theorem 3.14. □ 

The following result gives a precise sense to the word "necessary" in the 
title of this paper. 

Corollary 1. Any extension of ZFC that suffices to prove Proposition 
A for # -decreasing is an extension of ZFC in which ZFC + {there exists a 
k-subtle cardinal}^ is interpretable. The same result holds for all forms of 
Propositions A-D. 

Proof. This follows immediately from the first claim of Theorem 5.91 
and the usual proof of Godel's completeness theorem for first order predicate 
calculus with equality. □ 
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